-- Logs begin at Thu 2022-06-30 12:26:20 UTC, end at Thu 2022-06-30 13:29:34 UTC. -- Jun 30 12:57:21.230359 dv-cinder-812685-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 12:57:21.241812 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 12:57:21 2022] *** Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: nodename: dv-cinder-812685-14-iscsi Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: machine: x86_64 Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: clock source: unix Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: pcre jit disabled Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: detected number of CPU cores: 4 Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: current working directory: / Jun 30 12:57:21.244201 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: detected binary path: /usr/bin/uwsgi-core Jun 30 12:57:21.244872 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: your processes number limit is 47680 Jun 30 12:57:21.244872 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: your memory page size is 4096 bytes Jun 30 12:57:21.244872 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: detected max file descriptor number: 2048 Jun 30 12:57:21.244872 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: lock engine: pthread robust mutexes Jun 30 12:57:21.244872 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: thunder lock: enabled Jun 30 12:57:21.244872 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 12:57:21.244872 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 12:57:21.288759 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: Python main interpreter initialized at 0x557e4e1f49c0 Jun 30 12:57:21.288759 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: python threads support enabled Jun 30 12:57:21.288759 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: your server socket listen backlog is limited to 100 connections Jun 30 12:57:21.288759 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: your mercy for graceful operations on workers is 90 seconds Jun 30 12:57:21.289096 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 12:57:21.289171 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: *** Operational MODE: preforking *** Jun 30 12:57:21.289445 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: *** uWSGI is running in multiple interpreter mode *** Jun 30 12:57:21.289445 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: spawned uWSGI master process (pid: 103297) Jun 30 12:57:21.289651 dv-cinder-812685-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 12:57:21.290746 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: spawned uWSGI worker 1 (pid: 103298, cores: 1) Jun 30 12:57:21.290746 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: spawned uWSGI worker 2 (pid: 103299, cores: 1) Jun 30 12:57:21.290746 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 12:57:21.938162 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 12:57:21.940856 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 12:57:23.043252 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:57:23.043252 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: from cryptography.utils import int_from_bytes Jun 30 12:57:23.043909 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:57:23.043909 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: from cryptography.utils import int_from_bytes Jun 30 12:57:23.044850 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:57:23.044850 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: from cryptography.utils import int_from_bytes Jun 30 12:57:23.045300 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:57:23.045300 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: from cryptography.utils import int_from_bytes Jun 30 12:57:25.482045 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 12:57:25.482703 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 12:57:25.482794 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 12:57:25.482794 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 12:57:25.483198 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 12:57:25.483198 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 12:57:25.483343 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 12:57:25.483416 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 12:57:25.483492 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 12:57:25.483702 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.483834 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 12:57:25.483991 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.484082 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.484334 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.484483 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.484610 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.484716 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.484960 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.485104 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.485234 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.485335 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.485575 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.485706 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.485884 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.486031 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.486175 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.486340 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.486443 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.486525 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.486741 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.486828 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.487055 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-14-iscsi {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.487162 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.487367 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.487470 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-14-iscsi {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.487668 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.487759 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.487972 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.488070 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.488279 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.488363 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.488574 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.488663 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.488878 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.488974 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.489171 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.489254 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.489477 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.489660 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.489975 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.490112 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.490283 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.490403 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.490611 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.490695 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.491013 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.491126 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.491246 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.491436 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.491530 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.491628 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.491839 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.491932 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.492152 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.492249 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.492454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.492547 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.492769 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.492859 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.493072 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.493185 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-14-iscsi {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.493453 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.493554 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-14-iscsi {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.493754 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.493853 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.494059 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.494146 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.494389 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.494519 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.494776 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.494901 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.495091 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.495181 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.495379 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.495509 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.495697 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.495800 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.495995 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.496079 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.496302 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.496387 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.496609 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.496707 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.496918 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.497004 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.497227 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.497314 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.497543 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.497635 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.497895 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.497979 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.498202 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.498287 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.498534 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.498674 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.498846 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.498942 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.499140 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.499227 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.499382 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.499473 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.499667 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.499764 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.499968 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.500053 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.500282 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.500366 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.500594 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.500689 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.500840 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.500925 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.501082 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.501178 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.501368 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.501501 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.501679 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.501766 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.501976 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.502068 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.502274 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.502389 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.502600 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.502714 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.502899 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.502997 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.503500 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.503612 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.503702 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.503788 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.503868 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.503954 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.504034 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.504110 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.504349 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.504452 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.504662 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.504765 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.504969 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.505063 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.505267 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.505403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.505575 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.505715 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.505892 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.506023 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.506191 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.506359 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.506515 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.506603 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.506836 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.506945 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.507144 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.507231 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.507446 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.507540 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.507757 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.507848 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.508069 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.508160 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.508368 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.508462 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.508668 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.508755 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.508969 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.509058 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.509273 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.509369 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.509587 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.509685 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.509882 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.510019 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.510110 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.510189 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.510429 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.510522 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.510726 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.510822 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.511032 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.511126 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.511326 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.511411 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.511625 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.511735 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.511919 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.512004 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.512207 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.512318 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.512501 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.512597 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.512794 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.512884 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.513090 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.513496 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.513632 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.513721 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.513801 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.513929 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.514117 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.514269 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.514397 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.514567 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.514692 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.514872 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.514980 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.515170 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.515287 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.515472 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.515564 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.515792 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.515882 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.516104 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.516199 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.516405 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.516491 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.516699 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.516784 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.516997 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.517112 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.517294 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.517390 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.517588 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.517681 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.517891 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.517984 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.518194 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.518277 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.518516 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.518605 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.518822 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.518919 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.519118 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.519211 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.519416 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.519500 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.519716 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.519808 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.520012 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.520109 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.520310 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.520394 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.520606 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.520691 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.520906 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.520989 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.521202 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.521294 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.521497 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.521582 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.521792 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.521876 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.522089 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.522173 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.522405 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.522500 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.522700 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.522803 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.522996 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.523090 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.523285 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.523372 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.523580 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.523663 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.523875 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.523962 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.524180 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.524264 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.524481 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.524565 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.524778 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.524871 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.525079 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.525162 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.525385 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.525480 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.525700 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:57:25.525793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.526034 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.526119 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.526354 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.526439 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.526684 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.526781 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.527012 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.527097 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.527380 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.527475 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.527631 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.527724 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.527939 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.528031 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.528255 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.528349 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.528561 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.528645 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.528927 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.529024 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.529241 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.529325 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.529552 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.529638 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.529862 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.529946 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.530176 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.530286 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.530517 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.530617 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.530827 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.530912 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.531140 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.531225 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.531448 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.531533 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.531759 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.531842 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.532066 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.532148 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.532379 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.532465 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.532681 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.532764 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.533007 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.533098 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.533316 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.533401 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.533634 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.533717 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.533955 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.534052 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.534273 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.534403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.534601 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.534687 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.534909 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.535007 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.535214 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.535299 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.535519 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.535614 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.535831 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.535926 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.536133 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.536225 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.536443 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.536529 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.536748 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.536833 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.537054 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.537138 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.537363 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.537460 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.537671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.537765 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.537973 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.538057 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.538280 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.538392 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.538614 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.538700 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.538919 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.539002 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.539225 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.539309 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.539536 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.539622 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.539842 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.539933 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.540147 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.540230 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.540451 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.540548 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.540747 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.540840 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.541044 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.541146 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.541341 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.541432 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.541642 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.541726 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.541936 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.542023 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.542239 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.542348 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.542565 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.542649 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.542864 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.542960 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.543187 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.543280 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.543486 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.543569 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.543788 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.543881 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.544091 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.544175 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.544454 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.544551 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.544751 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.544843 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.545061 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.545146 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.545363 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.545447 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.545669 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.545805 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.545981 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.546081 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.546283 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.546402 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.546607 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.546704 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.546926 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.547020 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.547223 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.547309 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.547522 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.547617 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.547831 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.547925 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.548133 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.548231 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.548437 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.548522 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.548742 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.548827 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.549045 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.549140 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.549353 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.549440 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.549661 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.549748 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.549965 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.550065 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.550281 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.550402 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.550616 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.550712 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.550917 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.551013 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.551237 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.551324 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.551548 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.551648 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.551857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.551951 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.552158 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.552270 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.552464 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.552552 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.552766 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.552854 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.553068 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.553174 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.553365 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.553452 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.553662 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.553749 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.553957 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.554041 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.554253 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.554364 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.554573 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.554663 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.554868 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.554956 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.555163 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.555259 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.555460 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.555547 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.555761 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.555846 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.556058 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.556157 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.556355 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.556450 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.556651 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.556738 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.556948 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.557043 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.557248 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.557336 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.557584 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.557679 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.557885 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.557985 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.558203 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.558288 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.558540 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.558630 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.558845 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.558942 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.559152 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.559239 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.559455 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.559551 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.559766 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.559862 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.560095 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.560242 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.560394 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.560482 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.560699 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.560786 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.561003 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.561089 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.561318 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.561403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.561626 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.561720 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.561936 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.562021 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.562244 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.562387 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.562577 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.562665 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.562875 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.562961 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.563182 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.563268 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.563483 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.563587 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.563795 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.563881 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.564119 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.564217 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.564432 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.564521 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.564736 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.564830 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.565041 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.565137 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.565343 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.565430 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.565644 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.565731 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.565947 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.566043 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.566246 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.566365 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.566579 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.566674 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.566880 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.566967 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.567191 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.567277 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.567494 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.567587 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.567805 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.567892 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.568105 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.568198 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.568434 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.568547 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.568713 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.568810 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.569020 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.569121 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.569318 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.569422 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.569627 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.569720 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.569944 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.570048 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.570248 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.570373 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.570586 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.570681 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.570888 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.570975 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.571190 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.571283 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.571494 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.571580 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.571792 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.571877 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.572092 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.572186 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.572393 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.572484 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.572696 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.572788 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.572995 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.573088 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.573297 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.573404 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.573595 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.573679 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.573898 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.573984 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.574197 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.574279 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.574600 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.574809 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.574903 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.575107 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.575191 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.575406 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.575490 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.575755 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.575848 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.576066 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.576150 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.576379 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.576463 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.576679 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.576771 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.576973 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.577066 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.577287 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.577372 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.577591 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.577677 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.577888 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.577972 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.578188 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.578288 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.578511 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.578607 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.578847 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.578932 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.579150 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.579246 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.579446 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.579529 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.579762 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.579858 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.580075 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.580167 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.580377 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.580467 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.580688 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.580773 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.580995 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.581087 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.581297 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.581390 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.581601 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.581684 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.581911 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.581995 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.582215 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.582299 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.582554 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.582646 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.582861 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.582946 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.583171 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.583261 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.583479 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.583565 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.583785 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.583871 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.584088 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.584171 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.584393 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.584489 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.584696 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.584781 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.584993 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.585077 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.585295 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.585389 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.585599 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.585684 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.585906 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.586164 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.586255 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.586518 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.586800 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.586887 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.587131 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.587220 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.587443 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.587539 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.587753 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.587844 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.588067 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.588158 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.588383 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.588476 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.588711 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.588796 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.589009 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.589382 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.589464 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.589537 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.589956 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.590051 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.590228 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.590313 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.590560 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.590660 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.590862 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.590960 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.591163 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.591321 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.591577 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.591663 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.591887 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.592104 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.592197 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.592421 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.592513 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.592741 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.592855 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.593042 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.593126 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.593348 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.593432 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.593645 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.593736 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.593949 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.594040 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.594243 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.594353 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.594581 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.594684 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.594886 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.594979 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.595185 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.595270 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.595485 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.595577 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.595783 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.595867 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.596096 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.596181 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.596403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.596546 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.596708 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.596801 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.597042 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.597125 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.597342 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.597426 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.597665 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.597749 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.597964 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.598048 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.598282 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.598384 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.598612 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.598697 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.598911 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.599005 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.599207 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.599293 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.599512 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.599602 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.599811 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.599911 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.600105 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.600196 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.600410 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.600495 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.600714 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.600810 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.601011 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.601102 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.601309 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.601405 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.601605 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.601698 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.601907 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.601991 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.602202 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.602286 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.602526 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.602611 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.602828 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.602919 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.603122 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.603206 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.603415 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.603502 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.603717 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.603799 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.604016 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.604107 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.604312 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.604404 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.604613 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.604702 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.604909 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.605000 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.605207 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.605291 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.605502 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.605586 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.605799 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.605891 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.606096 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.606181 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.606422 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.606511 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.606725 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.606820 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.607079 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.607216 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.607386 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.607477 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.607690 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.607842 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.607987 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.608146 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.608281 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.608471 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.608570 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.608782 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.608872 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.609084 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.609171 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.609387 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.609473 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.609761 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.609861 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.609996 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.610084 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.610299 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.610419 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.610630 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.610717 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.610927 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.611013 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.611226 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.611326 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.611522 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.611609 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.611826 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.611913 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.612123 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.612219 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.612419 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.612506 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.612716 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.612818 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.613012 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.613099 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.613306 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.613390 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.613605 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.613689 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.613909 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.614042 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.614205 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.614288 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.614527 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.614617 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.614824 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.614917 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.615140 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.615224 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.615442 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.615535 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.615749 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.615836 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.616051 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.616136 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.616371 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.616463 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.616679 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.616763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.616981 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.617078 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.617284 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.617378 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.617592 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.617676 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.617888 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.617974 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.618194 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.618287 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.618522 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.618609 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.618828 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.618912 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.619122 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.619220 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.619436 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.619527 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.619746 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.619830 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.620059 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.620163 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.620360 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.620446 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.620662 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.620747 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.620975 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.621059 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.621283 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.621368 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.621578 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.621663 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.621885 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.621971 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.622187 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.622278 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.622534 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.622628 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.622855 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.622940 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.623244 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.623328 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.623555 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.623648 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.623862 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.623989 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.624166 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.624257 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.624472 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.624572 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.624777 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.624862 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.625077 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.625162 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.625384 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.625477 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.625693 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.625780 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.625992 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.626078 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.626292 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.626486 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.626623 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.626708 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.626919 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.627004 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.627219 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.627311 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.627515 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.627601 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.627819 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.627905 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.628114 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.628206 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.628420 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.628530 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.628727 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.628842 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.629035 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.629126 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.629338 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.629425 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.629708 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.629795 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.630013 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.630111 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.630329 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.630418 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.630648 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.630735 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.630944 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.631034 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.631255 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.631340 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.631570 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.631671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.631884 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.631971 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.632188 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.632275 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.632508 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.632603 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.632805 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.632909 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.633110 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.633217 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.633423 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.633520 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.633722 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.633816 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.634022 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.634128 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.634346 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.634455 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.634653 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.634740 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.634951 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.635040 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.635264 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.635353 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.635571 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.635657 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.635893 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.635980 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.636196 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.636292 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.636514 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.636647 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.636931 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.637018 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.637243 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.637330 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.637542 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.637627 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.637860 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.637946 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.638240 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.638362 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.638562 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.638831 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.638929 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.639161 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.639248 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.639475 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.639577 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.639798 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.639885 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.640106 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.640205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.640412 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.640514 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.640709 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.640797 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.641024 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.641112 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.641339 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.641429 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.641648 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.641737 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.641961 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.642052 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.642284 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.642394 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.642632 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.642720 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.642957 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.643044 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.643270 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.643364 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.643590 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.643677 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.643887 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.644005 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.644190 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.644328 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.644494 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.644637 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.644793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.644957 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.645092 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.645279 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.645408 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.645590 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.645710 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.645891 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.646015 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.646203 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.646335 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.646613 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.646701 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.646918 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.647015 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.647212 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.647299 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.647528 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.647625 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.647824 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.647912 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.648132 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.648219 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.648436 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.648533 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.648735 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.648906 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.649036 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.649130 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.649336 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.649432 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.649642 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.649729 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.649942 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.650028 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.650240 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.650363 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.650563 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.650663 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.650861 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.650949 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.651181 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.651276 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.651479 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.651566 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.651791 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.651877 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.652093 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.652182 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.652396 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.652484 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.652700 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.652787 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.653023 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.653111 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.653329 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.653425 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.653641 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.653734 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.653983 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.654125 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.654301 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.654487 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.654784 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.654891 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.655089 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.655177 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.655398 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.655486 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.655704 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.655801 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.656005 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.656099 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.656306 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.656393 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.656610 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.656707 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.656909 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.656997 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.657206 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.657296 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.657505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.657606 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.657806 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.657893 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.658103 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.658200 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.658431 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.658523 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.658735 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.658822 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.659033 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.659121 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.659332 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.659420 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.659631 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.659717 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.659937 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.660023 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.660250 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.660332 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.660554 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.660649 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.660857 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.660945 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.661162 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.661258 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.661464 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.661551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.661773 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.661868 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.662090 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.662176 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.662426 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.662529 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.662739 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.662835 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.663047 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.663135 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.663358 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.663473 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.663670 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.663774 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.663979 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.664323 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.664406 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.664485 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.664562 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.664649 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.664878 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.664973 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.665185 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.665278 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.665495 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.665590 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.665806 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.666007 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.666100 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.666351 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.666458 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.666665 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.666750 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.666974 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.667068 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.667284 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.667378 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.667593 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.667841 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.667934 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.668168 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.668261 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.668484 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.668570 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.668786 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.668871 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.669094 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.669200 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.669557 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.669659 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.669740 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.669817 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.670101 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.670196 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.670464 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.670573 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.670775 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.670869 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.671083 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.671178 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.671397 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.671488 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.671708 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.671800 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.672029 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.672121 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.672356 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.672448 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.672658 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.672746 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.672967 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.673055 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.673276 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.673361 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.673582 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.673678 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.673888 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.673974 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.674193 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.674278 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.674528 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.674645 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.674835 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.674921 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.675141 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.675226 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.675446 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.675533 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.675754 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.675847 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.676059 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.676150 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.676369 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.676454 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.676680 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.676768 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.676987 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.677072 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.677292 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.677385 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.677600 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.677693 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.677909 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.678002 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.678230 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.678433 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.678586 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.678744 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.678905 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.679069 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.679221 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.679391 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.679531 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.679710 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.679843 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.680017 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.680317 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.680409 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.680635 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.680726 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.680934 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.681034 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.681232 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.681321 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.681538 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.681624 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.681841 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.681934 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.682138 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.682224 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.682474 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.682564 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.682777 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.682864 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.683075 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.683174 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.683389 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.683476 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.683692 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.683777 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.683995 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.684214 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.684303 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.684553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.684655 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.684864 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.684956 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.685256 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.685342 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.685566 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.685795 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.686093 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.686187 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.686429 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.686527 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.686752 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.686839 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.687054 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.687140 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.687355 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.687441 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.687667 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.687754 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.687974 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.688059 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.688273 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.688360 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.688572 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.688659 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.688878 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.688971 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.689182 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.689295 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.689480 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.689570 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.689780 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.689876 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.690077 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.690175 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.690405 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.690495 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.690707 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.690805 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.691006 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.691103 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.691302 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.691388 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.691605 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.691690 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.691903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.691996 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.692198 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.692284 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.692495 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.692580 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.692792 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.692878 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.693098 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.693190 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.693392 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.693477 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.693692 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.693819 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.693988 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.694073 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.694287 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.694386 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.694608 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.694695 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.694910 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.694997 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.695219 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.695310 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.695522 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.695608 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.695832 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.695917 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.696128 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.696221 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.696433 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.696518 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.696734 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.696818 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.697047 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.697142 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.697351 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.697437 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.697654 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.697742 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.697963 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.698055 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.698269 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.698381 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.698613 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.698814 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.698923 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.699140 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.699226 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.699455 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.699561 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.699788 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.699881 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.700109 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.700385 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.700470 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.700807 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.700917 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.701061 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.701200 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.701375 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.701470 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.701681 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.701767 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.701983 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.702077 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.702283 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.702408 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.702610 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.702695 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.702911 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.702996 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.703213 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.703299 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.703516 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.703609 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.703821 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.703905 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.704120 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.704205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.704422 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.704515 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.704724 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.704817 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.705026 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.705110 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.705329 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.705421 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.705634 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.705718 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.705938 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.706025 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.706242 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.706348 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.706572 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.706659 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.706878 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.706964 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.707185 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.707271 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.707490 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.707576 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.707794 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.707879 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.708095 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.708181 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.708394 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.708479 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.708701 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.708860 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.709006 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.709090 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.709311 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.709398 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.709614 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.709719 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.709915 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.710021 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.710225 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.710365 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.710575 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.710674 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.710884 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.710971 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.711187 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.711272 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.711555 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.711647 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.711868 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.711955 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.712173 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.712259 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.712487 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.712575 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.712792 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.712884 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.713109 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.713193 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.713427 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.713520 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.713736 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.713822 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.714052 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.714147 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.714379 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.714475 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.715022 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.715112 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.715320 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.715418 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.715625 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.715711 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.715936 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.716040 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.716279 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.716447 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.716556 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.716645 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.716887 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.716975 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.717128 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.717225 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.717425 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.717512 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.717724 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.717819 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.718019 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.718106 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.718314 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.718434 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.718634 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.718731 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.718927 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.719016 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.719221 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.719314 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.719514 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.719616 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.719817 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.719913 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.720108 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.720192 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.720401 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.720486 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.720701 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.720786 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.720993 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.721076 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.721290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.721387 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.721584 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.721670 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.721879 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.721964 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.722172 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.722269 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.722494 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.722588 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.722796 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.722892 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.723104 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.723232 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.723403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.723503 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.723702 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.723790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.724009 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.724098 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.724311 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.724398 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.724620 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.724707 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.724931 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.725038 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.725241 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.725335 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.725542 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.725630 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.725847 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.725941 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.726154 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.726240 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.726477 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.726567 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.726781 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.726871 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.727084 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.727178 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.727386 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.727489 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.727688 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.727777 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.728001 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.728087 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.728313 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.728411 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.728611 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.728698 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.728915 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.729002 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.729223 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.729321 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.729541 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.729628 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.729850 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.729938 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.730152 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.730239 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.730496 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.730585 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.730803 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.730901 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.731110 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.731210 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.731417 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.731518 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.731724 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.731820 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.732078 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.732179 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.732392 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.732598 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.732683 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.732770 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.732994 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.733091 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.733301 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.733388 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.733604 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.733700 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.733916 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.734003 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.734230 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.734340 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.734579 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.734680 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.734886 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.734973 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.735202 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.735288 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.735523 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.735619 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.735829 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.735918 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.736132 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.736221 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.736431 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.736520 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.736667 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 12:57:25.736800 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.737125 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.737436 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.737746 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.738050 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:57:25.738289 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 12:57:25.893906 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO dbcounter [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Registered counter for database nova_api Jun 30 12:57:25.896027 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO dbcounter [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Registered counter for database nova_api Jun 30 12:57:25.916634 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG oslo_db.sqlalchemy.engines [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:57:25.918265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_db.sqlalchemy.engines [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:57:25.924075 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writer thread running {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:57:25.925295 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writer thread running {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:57:25.979087 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.context [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc35a938-b727-4fea-a6e5-cd9d9ebc6a61(cell1) {{(pid=103299) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 12:57:25.980880 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.context [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc35a938-b727-4fea-a6e5-cd9d9ebc6a61(cell1) {{(pid=103298) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 12:57:25.983125 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG oslo_concurrency.lockutils [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:57:25.984700 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG oslo_concurrency.lockutils [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:57:25.984854 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:57:25.985472 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG oslo_concurrency.lockutils [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:57:25.986373 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:57:25.987178 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 12:57:25.987439 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG oslo_concurrency.lockutils [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103299) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:57:25.989122 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 12:57:25.989404 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO dbcounter [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Registered counter for database nova_cell0 Jun 30 12:57:25.991119 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO dbcounter [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Registered counter for database nova_cell0 Jun 30 12:57:25.994952 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO dbcounter [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Registered counter for database nova_cell1 Jun 30 12:57:25.996484 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO dbcounter [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Registered counter for database nova_cell1 Jun 30 12:57:26.002428 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG oslo_db.sqlalchemy.engines [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:57:26.004110 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_db.sqlalchemy.engines [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:57:26.007473 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_db.sqlalchemy.engines [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:57:26.007751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writer thread running {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:57:26.010345 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writer thread running {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:57:26.012490 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG oslo_db.sqlalchemy.engines [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:57:26.144948 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writer thread running {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:57:26.147032 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writer thread running {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:57:26.155013 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO dbcounter [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Registered counter for database nova_cell0 Jun 30 12:57:26.155980 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO dbcounter [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Registered counter for database nova_cell0 Jun 30 12:57:26.163790 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_db.sqlalchemy.engines [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:57:26.167315 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG oslo_db.sqlalchemy.engines [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:57:26.168323 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writer thread running {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:57:26.172479 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writer thread running {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:57:26.505939 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: WARNING keystonemiddleware.auth_token [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:57:26.512978 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: WARNING keystonemiddleware.auth_token [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:57:26.513477 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: WARNING keystonemiddleware.auth_token [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:57:26.520838 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: WARNING keystonemiddleware.auth_token [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:57:26.855305 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: WARNING keystonemiddleware.auth_token [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:57:26.861450 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: WARNING keystonemiddleware.auth_token [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:57:26.866758 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557e4e1f49c0 pid: 103298 (default app) Jun 30 12:57:26.868837 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:57:26.870024 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jun 30 12:57:26.870445 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Thu Jun 30 12:57:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:57:26.875414 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: WARNING keystonemiddleware.auth_token [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 12:57:26.881416 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: WARNING keystonemiddleware.auth_token [None req-d1fa3d91-c3c4-4043-9243-2affd9e0a71f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 12:57:26.886708 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557e4e1f49c0 pid: 103299 (default app) Jun 30 12:58:41.902181 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:41.903257 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 30 12:58:41.903836 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:58:41.930988 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writing DB stats nova_api:SELECT=3 {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:41.932757 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writing DB stats nova_cell1:SELECT=3 {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:41.933823 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writing DB stats nova_cell0:SELECT=3 {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:41.935839 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:42.368326 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-53d7231c-9fff-409e-ab07-1fe431c87a8b admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:42.398920 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-53d7231c-9fff-409e-ab07-1fe431c87a8b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487464 Jun 30 12:58:42.399691 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Thu Jun 30 12:58:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:58:44.448650 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:44.449678 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-cb32ade1-5ef1-4875-86f0-2040027fa32c None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 30 12:58:44.450109 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:58:44.513393 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-0524145e-c9e7-4120-8ad1-49a4da399905 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "swap": 0}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:44.531521 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:58:44.531521 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: warnings.warn(msg) Jun 30 12:58:44.561162 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-0524145e-c9e7-4120-8ad1-49a4da399905 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104801 Jun 30 12:58:44.562220 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:58:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:58:44.575432 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_api:SELECT=3 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:44.576601 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_cell0:SELECT=3 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:44.577602 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_cell1:SELECT=3 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:44.578362 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:44.780995 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-7166f417-1540-4e31-ab44-0542f914c351 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:44.783506 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:58:44.783506 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: warnings.warn(msg) Jun 30 12:58:44.847326 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-7166f417-1540-4e31-ab44-0542f914c351 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276934 Jun 30 12:58:44.848014 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Thu Jun 30 12:58:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:58:46.891572 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-0524145e-c9e7-4120-8ad1-49a4da399905 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:46.893225 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-0524145e-c9e7-4120-8ad1-49a4da399905 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Jun 30 12:58:46.893727 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:58:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:58:47.013298 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-a05f390b-2a79-4c1d-b7a7-0c456fdc2783 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "id": "d1"}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:47.032545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:58:47.032545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: warnings.warn(msg) Jun 30 12:58:47.055313 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-a05f390b-2a79-4c1d-b7a7-0c456fdc2783 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153905 Jun 30 12:58:47.055915 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:58:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:58:47.068017 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-d6d087fc-e16b-4777-ba49-e2d2f870471c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:47.069543 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:58:47.069543 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: warnings.warn(msg) Jun 30 12:58:47.103637 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-d6d087fc-e16b-4777-ba49-e2d2f870471c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039238 Jun 30 12:58:47.104169 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Thu Jun 30 12:58:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:58:49.187490 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-a05f390b-2a79-4c1d-b7a7-0c456fdc2783 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:49.189294 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-a05f390b-2a79-4c1d-b7a7-0c456fdc2783 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002460 Jun 30 12:58:49.189971 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:58:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:58:49.253277 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-bd79ce24-7deb-4d9b-a515-9c3a8143e772 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:49.277715 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-bd79ce24-7deb-4d9b-a515-9c3a8143e772 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081135 Jun 30 12:58:49.278376 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:58:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 12:58:49.290522 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-72969f53-8f16-46f4-85a1-9c96f7e2760d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:49.315069 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-72969f53-8f16-46f4-85a1-9c96f7e2760d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028143 Jun 30 12:58:49.315645 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Thu Jun 30 12:58:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:58:51.361182 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-bd79ce24-7deb-4d9b-a515-9c3a8143e772 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:51.362181 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-bd79ce24-7deb-4d9b-a515-9c3a8143e772 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 30 12:58:51.362610 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:58:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:58:51.423011 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-65ff7bda-fcae-48de-9b93-0644ad5f6440 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "vcpus": 2, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:51.441069 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-65ff7bda-fcae-48de-9b93-0644ad5f6440 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072448 Jun 30 12:58:51.441604 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:58:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:58:51.453475 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-e1436cb1-adf9-4c83-bc97-96b4a673bfe2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:51.477387 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-e1436cb1-adf9-4c83-bc97-96b4a673bfe2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027600 Jun 30 12:58:51.478035 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Thu Jun 30 12:58:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:58:53.541373 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-65ff7bda-fcae-48de-9b93-0644ad5f6440 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:53.542371 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-65ff7bda-fcae-48de-9b93-0644ad5f6440 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 30 12:58:53.542784 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:58:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:58:53.607946 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-ba00214a-7e80-4163-8dba-bf050891a37b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:53.627499 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-ba00214a-7e80-4163-8dba-bf050891a37b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078603 Jun 30 12:58:53.628258 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:58:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 12:58:53.640134 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-693cea40-ed45-4792-8139-f407d4b88efa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:53.665016 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-693cea40-ed45-4792-8139-f407d4b88efa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028551 Jun 30 12:58:53.665578 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Thu Jun 30 12:58:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:58:55.758223 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-ba00214a-7e80-4163-8dba-bf050891a37b admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:55.759300 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-ba00214a-7e80-4163-8dba-bf050891a37b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Jun 30 12:58:55.759705 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:58:55.824495 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-f067ee50-97a1-4126-83d1-ac524ca46700 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:55.849582 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-f067ee50-97a1-4126-83d1-ac524ca46700 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083775 Jun 30 12:58:55.850199 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Thu Jun 30 12:58:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:58:57.945431 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-ba00214a-7e80-4163-8dba-bf050891a37b admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:58:57.946691 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-ba00214a-7e80-4163-8dba-bf050891a37b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Jun 30 12:58:57.947200 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:58:58.019345 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-e140cd4e-7469-42ee-8963-eda7475407df admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:58.042136 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-e140cd4e-7469-42ee-8963-eda7475407df admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088927 Jun 30 12:58:58.042724 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:58:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:58:58.057101 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-39178d43-348e-4e8e-9494-c531d8fc59a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:58:58.082676 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-39178d43-348e-4e8e-9494-c531d8fc59a3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029407 Jun 30 12:58:58.083486 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Thu Jun 30 12:58:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:59:00.685177 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-e140cd4e-7469-42ee-8963-eda7475407df admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:00.686195 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-e140cd4e-7469-42ee-8963-eda7475407df admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 30 12:59:00.686651 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:00.748499 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-b9ed88f9-dff2-4450-ae88-97dc01fc6043 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:00.767931 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-b9ed88f9-dff2-4450-ae88-97dc01fc6043 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075092 Jun 30 12:59:00.768489 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:59:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:59:00.780423 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-68ef2d5b-c036-4da8-9829-d1552fe85b23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:00.805390 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-68ef2d5b-c036-4da8-9829-d1552fe85b23 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028619 Jun 30 12:59:00.805999 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Thu Jun 30 12:59:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 12:59:03.269789 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-b9ed88f9-dff2-4450-ae88-97dc01fc6043 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:03.270969 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-b9ed88f9-dff2-4450-ae88-97dc01fc6043 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Jun 30 12:59:03.271491 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:03.331162 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-afda17b8-8e46-4688-86b1-2f3f936c3055 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "name": "m1.medium", "swap": 0}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:03.358119 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-afda17b8-8e46-4688-86b1-2f3f936c3055 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080321 Jun 30 12:59:03.359698 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:59:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:59:03.372129 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-beb98187-b7e7-44aa-9b41-037e267af747 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:03.396935 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-beb98187-b7e7-44aa-9b41-037e267af747 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028540 Jun 30 12:59:03.397559 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Thu Jun 30 12:59:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:59:05.587659 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-afda17b8-8e46-4688-86b1-2f3f936c3055 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:05.588341 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-afda17b8-8e46-4688-86b1-2f3f936c3055 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 30 12:59:05.588740 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:59:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:05.646752 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-1e93f344-de44-483d-96bb-02b8a86edd84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "swap": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:05.665418 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-1e93f344-de44-483d-96bb-02b8a86edd84 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070163 Jun 30 12:59:05.665974 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:59:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:59:05.677983 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-298a7ea2-4da8-4b30-bf33-d27dd627ece6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:05.700790 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-298a7ea2-4da8-4b30-bf33-d27dd627ece6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026450 Jun 30 12:59:05.701354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Thu Jun 30 12:59:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:59:07.781321 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-1e93f344-de44-483d-96bb-02b8a86edd84 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:07.782982 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-1e93f344-de44-483d-96bb-02b8a86edd84 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002177 Jun 30 12:59:07.783789 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:07.846053 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-ec7b3c90-0dad-4f99-9dde-7da24d82f151 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5"}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:07.864650 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-ec7b3c90-0dad-4f99-9dde-7da24d82f151 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075076 Jun 30 12:59:07.865387 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Thu Jun 30 12:59:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:59:07.877534 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-daaa9201-594b-4b3e-a61d-ad917db1fb1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:07.902755 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-daaa9201-594b-4b3e-a61d-ad917db1fb1b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029164 Jun 30 12:59:07.904038 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Thu Jun 30 12:59:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 12:59:31.651166 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-ec7b3c90-0dad-4f99-9dde-7da24d82f151 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:31.652375 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-ec7b3c90-0dad-4f99-9dde-7da24d82f151 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001934 Jun 30 12:59:31.652889 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 12:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:31.665556 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:59:31.716465 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-e2992001-b8aa-4de1-a19e-032e353aa110 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:31.734662 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-e2992001-b8aa-4de1-a19e-032e353aa110 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075541 Jun 30 12:59:31.735216 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Thu Jun 30 12:59:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 12:59:32.656038 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-ec7b3c90-0dad-4f99-9dde-7da24d82f151 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:32.657175 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-ec7b3c90-0dad-4f99-9dde-7da24d82f151 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001891 Jun 30 12:59:32.657575 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 12:59:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:32.851400 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-2a2b22bc-9196-4ce1-800e-b4c98e3d0870 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:32.857309 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.wsgi [None req-2a2b22bc-9196-4ce1-800e-b4c98e3d0870 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-2a2b22bc-9196-4ce1-800e-b4c98e3d0870 admin admin] Request method failure captured: Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Accept: application/json Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Accept-Encoding: gzip, deflate Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Connection: keep-alive Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Content-Length: 0 Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Host: 10.222.0.49 Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Openstack-Api-Version: compute 2.90 Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Openstack-System-Scope: None Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: User-Agent: python-novaclient Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Auth-Token: gAAAAABivZ40ifQWq47RfsT-lfDDpgIUM-X4eP4RL-NSAhrbC66q-ss4qRD9FeNC0TVDYqydBNtO3WU3pujJw5pre-g36QjjXQjrzwG4Wf2hDVAf2tQCyVssUoz3xtSrcWBdOpBaGcwXaQKqiNyreer__chJDHvteDUXAVPwwVW3NiU6EjILaFY Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Domain-Id: None Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Domain-Name: None Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Identity-Status: Confirmed Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Is-Admin-Project: True Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Domain-Id: default Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Domain-Name: Default Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Name: admin Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Role: member,reader,admin Jun 30 12:59:32.860793 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Roles: member,reader,admin Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}] Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant: admin Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant-Name: admin Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User: admin Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Domain-Id: default Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Domain-Name: Default Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Id: b45b25b709bf447ca67a413397143f8d Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Name: admin Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: method: > Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: exception: Flavor 42 could not be found. Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: action_args: {'id': '42'} Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:59:32.862532 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:32.863553 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.864903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-2a2b22bc-9196-4ce1-800e-b4c98e3d0870 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:59:32.866254 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-2a2b22bc-9196-4ce1-800e-b4c98e3d0870 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068548 Jun 30 12:59:32.866254 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Thu Jun 30 12:59:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:59:32.871982 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-91619ba5-3665-461c-ac75-5dcc0c40a70f admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:32.874989 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:59:32.895250 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-91619ba5-3665-461c-ac75-5dcc0c40a70f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026819 Jun 30 12:59:32.895831 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Jun 30 12:59:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:59:32.909066 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-e9b17c5a-fc38-4f69-80bd-7ccc278c4f1c admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:32.934827 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-e9b17c5a-fc38-4f69-80bd-7ccc278c4f1c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032076 Jun 30 12:59:32.935345 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Jun 30 12:59:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:59:32.945700 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-3549d32c-3514-4506-897e-9e7d80db6230 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:32.951974 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.wsgi [None req-3549d32c-3514-4506-897e-9e7d80db6230 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-3549d32c-3514-4506-897e-9e7d80db6230 admin admin] Request method failure captured: Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Accept: application/json Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Accept-Encoding: gzip, deflate Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Connection: keep-alive Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Content-Length: 0 Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Host: 10.222.0.49 Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Openstack-Api-Version: compute 2.90 Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Openstack-System-Scope: None Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: User-Agent: python-novaclient Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Auth-Token: gAAAAABivZ40ifQWq47RfsT-lfDDpgIUM-X4eP4RL-NSAhrbC66q-ss4qRD9FeNC0TVDYqydBNtO3WU3pujJw5pre-g36QjjXQjrzwG4Wf2hDVAf2tQCyVssUoz3xtSrcWBdOpBaGcwXaQKqiNyreer__chJDHvteDUXAVPwwVW3NiU6EjILaFY Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Domain-Id: None Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Domain-Name: None Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Identity-Status: Confirmed Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Is-Admin-Project: True Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Domain-Id: default Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Domain-Name: Default Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Name: admin Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Role: member,reader,admin Jun 30 12:59:32.955354 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Roles: member,reader,admin Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}] Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant: admin Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant-Name: admin Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User: admin Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Domain-Id: default Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Domain-Name: Default Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Id: b45b25b709bf447ca67a413397143f8d Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Name: admin Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: method: > Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: exception: Flavor 42 could not be found. Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: action_args: {'id': '42'} Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:59:32.956671 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:32.957454 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:32.958545 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-3549d32c-3514-4506-897e-9e7d80db6230 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:59:32.959508 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-3549d32c-3514-4506-897e-9e7d80db6230 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014876 Jun 30 12:59:32.959508 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Thu Jun 30 12:59:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:59:33.770153 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-e9b17c5a-fc38-4f69-80bd-7ccc278c4f1c admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:33.771259 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-e9b17c5a-fc38-4f69-80bd-7ccc278c4f1c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jun 30 12:59:33.771655 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 12:59:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:33.976970 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-894f9824-bd39-49af-b2b6-38fb5a00f3fc admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:33.983225 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.wsgi [None req-894f9824-bd39-49af-b2b6-38fb5a00f3fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-894f9824-bd39-49af-b2b6-38fb5a00f3fc admin admin] Request method failure captured: Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Accept: application/json Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Accept-Encoding: gzip, deflate Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Connection: keep-alive Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Content-Length: 0 Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Host: 10.222.0.49 Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Openstack-Api-Version: compute 2.90 Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Openstack-System-Scope: None Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: User-Agent: python-novaclient Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Auth-Token: gAAAAABivZ41-q1dhmXVW-TYf6UJWNUYDHn6xCi_pKaHueK-lFB45u_mb_sKNn1c1DRffF7XBEICErp4v6zehG2FWv4fwu69GmpkhA_lC43VsBm61IufCm8fQ3PYc-LaY5R-yvFl5z2-hTbqEPwStRkwswqHv0yAaa9NX62gJQIF7WqbucSIcWk Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Domain-Id: None Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Domain-Name: None Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Identity-Status: Confirmed Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Is-Admin-Project: True Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Domain-Id: default Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Domain-Name: Default Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Name: admin Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Role: member,reader,admin Jun 30 12:59:33.984787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Roles: member,reader,admin Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}] Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant: admin Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant-Name: admin Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User: admin Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Domain-Id: default Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Domain-Name: Default Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Id: b45b25b709bf447ca67a413397143f8d Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Name: admin Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: method: > Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: exception: Flavor 84 could not be found. Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: action_args: {'id': '84'} Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:59:33.986265 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:33.987205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:33.988536 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-894f9824-bd39-49af-b2b6-38fb5a00f3fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:59:33.989808 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-894f9824-bd39-49af-b2b6-38fb5a00f3fc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.078369 Jun 30 12:59:33.989808 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Thu Jun 30 12:59:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:59:33.997554 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-892cd477-e35e-4532-8385-230f1da138ed admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:34.013491 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-892cd477-e35e-4532-8385-230f1da138ed admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019618 Jun 30 12:59:34.014033 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Jun 30 12:59:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:59:34.024196 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-111b70e3-15e7-4193-a005-58f1e887fb41 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:34.039917 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-111b70e3-15e7-4193-a005-58f1e887fb41 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019324 Jun 30 12:59:34.040448 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Jun 30 12:59:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:59:34.050003 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-18099fb8-bafe-4e61-983a-547b8d771466 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:34.055990 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.wsgi [None req-18099fb8-bafe-4e61-983a-547b8d771466 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-18099fb8-bafe-4e61-983a-547b8d771466 admin admin] Request method failure captured: Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Accept: application/json Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Accept-Encoding: gzip, deflate Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Connection: keep-alive Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Content-Length: 0 Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Host: 10.222.0.49 Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Openstack-Api-Version: compute 2.90 Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Openstack-System-Scope: None Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: User-Agent: python-novaclient Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Auth-Token: gAAAAABivZ41-q1dhmXVW-TYf6UJWNUYDHn6xCi_pKaHueK-lFB45u_mb_sKNn1c1DRffF7XBEICErp4v6zehG2FWv4fwu69GmpkhA_lC43VsBm61IufCm8fQ3PYc-LaY5R-yvFl5z2-hTbqEPwStRkwswqHv0yAaa9NX62gJQIF7WqbucSIcWk Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Domain-Id: None Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Domain-Name: None Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Identity-Status: Confirmed Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Is-Admin-Project: True Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Domain-Id: default Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Domain-Name: Default Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Name: admin Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Role: member,reader,admin Jun 30 12:59:34.057505 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Roles: member,reader,admin Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}] Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant: admin Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant-Name: admin Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User: admin Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Domain-Id: default Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Domain-Name: Default Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Id: b45b25b709bf447ca67a413397143f8d Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Name: admin Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: method: > Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: exception: Flavor 84 could not be found. Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: action_args: {'id': '84'} Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:59:34.058857 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:34.059671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:34.060790 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-18099fb8-bafe-4e61-983a-547b8d771466 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:59:34.061797 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-18099fb8-bafe-4e61-983a-547b8d771466 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012595 Jun 30 12:59:34.061797 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Thu Jun 30 12:59:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:59:34.901405 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-111b70e3-15e7-4193-a005-58f1e887fb41 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:34.902447 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-111b70e3-15e7-4193-a005-58f1e887fb41 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 30 12:59:34.902875 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 12:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:35.109356 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-c189a6f2-5c36-4a35-bf4a-10a9279b9dc4 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:35.115768 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.wsgi [None req-c189a6f2-5c36-4a35-bf4a-10a9279b9dc4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-c189a6f2-5c36-4a35-bf4a-10a9279b9dc4 admin admin] Request method failure captured: Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Accept: application/json Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Accept-Encoding: gzip, deflate Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Connection: keep-alive Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Content-Length: 0 Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Host: 10.222.0.49 Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Openstack-Api-Version: compute 2.90 Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Openstack-System-Scope: None Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: User-Agent: python-novaclient Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Auth-Token: gAAAAABivZ42RbVZ2NVZAhq75m8shhBH3O4j_RLdUSFIBI4bfTGigc2E6Kq9hcVkjo3qKKv6ZNu5bm46Ey15bTOFCL15aLe2U0l0Sjszd87QL3QP5ZmvW5ETUZC0uwrudh2h5nX-Qxk1PJ7HzBQ_HO0nF15xt8BkjsKFQWOOy4IdfgX1uzih-JI Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Domain-Id: None Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Domain-Name: None Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Identity-Status: Confirmed Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Is-Admin-Project: True Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Domain-Id: default Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Domain-Name: Default Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Project-Name: admin Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Role: member,reader,admin Jun 30 12:59:35.117290 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Roles: member,reader,admin Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}] Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant: admin Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-Tenant-Name: admin Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User: admin Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Domain-Id: default Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Domain-Name: Default Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Id: b45b25b709bf447ca67a413397143f8d Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: X-User-Name: admin Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: method: > Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: exception: Flavor 451 could not be found. Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: action_args: {'id': '451'} Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:59:35.118751 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:35.119551 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.120763 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-c189a6f2-5c36-4a35-bf4a-10a9279b9dc4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103299) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:59:35.121947 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-c189a6f2-5c36-4a35-bf4a-10a9279b9dc4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.079350 Jun 30 12:59:35.121947 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Jun 30 12:59:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:59:35.128938 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-5236af95-572f-448d-a7fb-af6d31ed3b69 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:35.142982 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-5236af95-572f-448d-a7fb-af6d31ed3b69 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017789 Jun 30 12:59:35.143543 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Jun 30 12:59:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:59:35.152858 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:35.166920 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017510 Jun 30 12:59:35.167473 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Thu Jun 30 12:59:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 12:59:35.176789 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-aada37ff-4d1b-4e60-84db-c7912d4f9767 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:35.182205 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.wsgi [None req-aada37ff-4d1b-4e60-84db-c7912d4f9767 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-aada37ff-4d1b-4e60-84db-c7912d4f9767 admin admin] Request method failure captured: Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Accept: application/json Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Accept-Encoding: gzip, deflate Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Connection: keep-alive Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Content-Length: 0 Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Host: 10.222.0.49 Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Openstack-Api-Version: compute 2.90 Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Openstack-System-Scope: None Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: User-Agent: python-novaclient Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Auth-Token: gAAAAABivZ42RbVZ2NVZAhq75m8shhBH3O4j_RLdUSFIBI4bfTGigc2E6Kq9hcVkjo3qKKv6ZNu5bm46Ey15bTOFCL15aLe2U0l0Sjszd87QL3QP5ZmvW5ETUZC0uwrudh2h5nX-Qxk1PJ7HzBQ_HO0nF15xt8BkjsKFQWOOy4IdfgX1uzih-JI Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Domain-Id: None Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Domain-Name: None Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Identity-Status: Confirmed Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Is-Admin-Project: True Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Domain-Id: default Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Domain-Name: Default Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Project-Name: admin Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Role: member,reader,admin Jun 30 12:59:35.183733 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Roles: member,reader,admin Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_288f97ff4fc34a4e979d3c926f4a9c7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/288f97ff4fc34a4e979d3c926f4a9c7f"}]}] Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant: admin Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant-Id: 288f97ff4fc34a4e979d3c926f4a9c7f Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-Tenant-Name: admin Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User: admin Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Domain-Id: default Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Domain-Name: Default Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Id: b45b25b709bf447ca67a413397143f8d Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: X-User-Name: admin Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: method: > Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: exception: Flavor 451 could not be found. Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: action_args: {'id': '451'} Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 12:59:35.185252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:35.186403 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: ERROR nova.api.openstack.wsgi Jun 30 12:59:35.187829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-aada37ff-4d1b-4e60-84db-c7912d4f9767 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103298) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 12:59:35.189121 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-aada37ff-4d1b-4e60-84db-c7912d4f9767 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011771 Jun 30 12:59:35.189121 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Jun 30 12:59:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 12:59:36.025657 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:36.026716 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 30 12:59:36.027109 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 12:59:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:36.217511 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-eec865ca-f4fe-4829-8f5f-755e9d5d7ae2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:36.238209 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-eec865ca-f4fe-4829-8f5f-755e9d5d7ae2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075868 Jun 30 12:59:36.238813 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Thu Jun 30 12:59:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:59:37.062101 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:37.063248 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Jun 30 12:59:37.063671 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 12:59:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:37.261750 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-0fa74bd9-311d-486f-b77d-3d01b66c8efb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:37.284348 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-0fa74bd9-311d-486f-b77d-3d01b66c8efb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.083084 Jun 30 12:59:37.284820 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Thu Jun 30 12:59:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:59:38.108966 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:38.110049 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jun 30 12:59:38.110491 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 12:59:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:38.310353 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-027c4864-c1d4-42cf-9b7f-324f14b63a1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:38.332705 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-027c4864-c1d4-42cf-9b7f-324f14b63a1d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083978 Jun 30 12:59:38.333188 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Thu Jun 30 12:59:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:59:39.161801 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:39.162853 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 30 12:59:39.163256 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 12:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 12:59:39.386891 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-c2212cba-a6cd-40e4-92e5-92b5a9d3e0ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 12:59:39.408016 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-c2212cba-a6cd-40e4-92e5-92b5a9d3e0ab admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.107897 Jun 30 12:59:39.408582 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Thu Jun 30 12:59:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 12:59:40.228674 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:40.230232 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Jun 30 12:59:40.230897 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 12:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 12:59:40.434482 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-aa9a6ffd-ae08-4994-a527-d66996e8c25a admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 12:59:40.453842 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-aa9a6ffd-ae08-4994-a527-d66996e8c25a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080638 Jun 30 12:59:40.454369 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Thu Jun 30 12:59:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:00:27.251879 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:00:27.252903 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-88202883-4df5-469a-b123-fe6166306094 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 30 13:00:27.253792 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Thu Jun 30 13:00:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:00:27.265172 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:27.315630 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-1a813365-1910-4227-b8cf-e91dabf5cda3 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:00:27.335421 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-1a813365-1910-4227-b8cf-e91dabf5cda3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075187 Jun 30 13:00:27.335983 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Thu Jun 30 13:00:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:00:27.360403 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-223e3a8e-fd7c-4fb8-ad36-5d0302525a68 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:00:27.363929 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG dbcounter [-] [103299] Writing DB stats nova_api:SELECT=14 {{(pid=103299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:27.369388 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-223e3a8e-fd7c-4fb8-ad36-5d0302525a68 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013395 Jun 30 13:00:27.369942 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Thu Jun 30 13:00:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:00:27.382547 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-df3b15d2-ab0b-4b0b-aa9c-3c2cedd7703f admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:00:27.390515 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-df3b15d2-ab0b-4b0b-aa9c-3c2cedd7703f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011567 Jun 30 13:00:27.391047 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Thu Jun 30 13:00:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:00:27.403148 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:00:27.411694 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012481 Jun 30 13:00:27.412390 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Thu Jun 30 13:00:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:00:27.425747 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-150d1f67-3ad3-44a5-a016-9e5f7d22ccb8 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:00:27.433534 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-150d1f67-3ad3-44a5-a016-9e5f7d22ccb8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011442 Jun 30 13:00:27.434111 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Thu Jun 30 13:00:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:03:42.274815 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:03:42.275816 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 30 13:03:42.286414 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 13:03:42 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:03:42.415365 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_api:SELECT=6 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:03:42.551131 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-0285bf6e-18ab-420e-adbc-b855231fe491 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:03:42.552380 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:03:42.552380 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: warnings.warn(msg) Jun 30 13:03:42.553564 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-0285bf6e-18ab-420e-adbc-b855231fe491 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:03:42.553988 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-0285bf6e-18ab-420e-adbc-b855231fe491 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:03:42.554792 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-0285bf6e-18ab-420e-adbc-b855231fe491 admin admin] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:03:42.555196 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-0285bf6e-18ab-420e-adbc-b855231fe491 admin admin] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:03:42.589349 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-0285bf6e-18ab-420e-adbc-b855231fe491 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.175905 Jun 30 13:03:42.590087 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Jun 30 13:03:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 13:03:43.426106 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:03:43.427146 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 30 13:03:43.427545 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 13:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:03:43.624799 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-c20a5b7d-9620-4ac3-855a-0353fa7e763b admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:03:43.625966 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:03:43.625966 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: warnings.warn(msg) Jun 30 13:03:43.627184 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-c20a5b7d-9620-4ac3-855a-0353fa7e763b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:03:43.627677 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-c20a5b7d-9620-4ac3-855a-0353fa7e763b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:03:43.628446 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-c20a5b7d-9620-4ac3-855a-0353fa7e763b admin admin] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:03:43.628870 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-c20a5b7d-9620-4ac3-855a-0353fa7e763b admin admin] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:03:43.648048 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-c20a5b7d-9620-4ac3-855a-0353fa7e763b admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.083272 Jun 30 13:03:43.648595 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Jun 30 13:03:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 13:03:54.937172 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:03:54.938225 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 30 13:03:54.938662 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 13:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:03:55.079994 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_cell0:SELECT=4 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:03:55.080624 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_cell1:SELECT=4 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:03:55.081199 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG dbcounter [-] [103298] Writing DB stats nova_api:SELECT=8 {{(pid=103298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:03:55.129898 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-4cdb4c64-d627-4543-9112-7bd7599bbce0 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:03:55.131117 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:03:55.131117 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: warnings.warn(msg) Jun 30 13:03:55.132285 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-4cdb4c64-d627-4543-9112-7bd7599bbce0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:03:55.132712 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-4cdb4c64-d627-4543-9112-7bd7599bbce0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:03:55.133481 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-4cdb4c64-d627-4543-9112-7bd7599bbce0 admin admin] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:03:55.133895 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-4cdb4c64-d627-4543-9112-7bd7599bbce0 admin admin] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:03:55.158459 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-4cdb4c64-d627-4543-9112-7bd7599bbce0 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082956 Jun 30 13:03:55.159004 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Jun 30 13:03:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:03:56.018779 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: DEBUG nova.api.openstack.wsgi [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] Calling method '>' {{(pid=103299) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:03:56.019822 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: INFO nova.api.openstack.requestlog [None req-efdc6737-e66e-4963-ba7d-480e530855a6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 30 13:03:56.020220 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: [pid: 103299|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Thu Jun 30 13:03:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:03:56.232203 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG nova.api.openstack.wsgi [None req-67ef9526-728e-4144-9faa-c92d564af727 admin admin] Calling method '>' {{(pid=103298) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:03:56.233395 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 13:03:56.233395 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: warnings.warn(msg) Jun 30 13:03:56.234602 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-67ef9526-728e-4144-9faa-c92d564af727 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:03:56.235037 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-67ef9526-728e-4144-9faa-c92d564af727 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:03:56.235829 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-67ef9526-728e-4144-9faa-c92d564af727 admin admin] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:03:56.236252 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: DEBUG oslo_concurrency.lockutils [None req-67ef9526-728e-4144-9faa-c92d564af727 admin admin] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103298) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:03:56.257787 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: INFO nova.api.openstack.requestlog [None req-67ef9526-728e-4144-9faa-c92d564af727 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085078 Jun 30 13:03:56.258352 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: [pid: 103298|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Thu Jun 30 13:03:56 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:04:53.776216 dv-cinder-812685-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 13:04:53.776867 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: Thu Jun 30 13:04:53 2022 - graceful shutdown triggered... Jun 30 13:04:53.777313 dv-cinder-812685-14-iscsi devstack@n-api.service[103298]: Gracefully killing worker 1 (pid: 103298)... Jun 30 13:04:53.777677 dv-cinder-812685-14-iscsi devstack@n-api.service[103299]: Gracefully killing worker 2 (pid: 103299)... Jun 30 13:04:54.777873 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: worker 1 buried after 1 seconds Jun 30 13:04:54.777873 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: worker 2 buried after 1 seconds Jun 30 13:04:54.777873 dv-cinder-812685-14-iscsi devstack@n-api.service[103297]: goodbye to uWSGI. Jun 30 13:04:54.780433 dv-cinder-812685-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 13:04:54.781353 dv-cinder-812685-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 13:04:54.785840 dv-cinder-812685-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 13:04:54.802565 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 13:04:54 2022] *** Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: nodename: dv-cinder-812685-14-iscsi Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: machine: x86_64 Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: clock source: unix Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: pcre jit disabled Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: detected number of CPU cores: 4 Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: current working directory: / Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: detected binary path: /usr/bin/uwsgi-core Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: your processes number limit is 47680 Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: your memory page size is 4096 bytes Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: detected max file descriptor number: 2048 Jun 30 13:04:54.804758 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: lock engine: pthread robust mutexes Jun 30 13:04:54.805657 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: thunder lock: enabled Jun 30 13:04:54.805657 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 13:04:54.805657 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 13:04:54.849724 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: Python main interpreter initialized at 0x55922048a9c0 Jun 30 13:04:54.849724 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: python threads support enabled Jun 30 13:04:54.849724 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: your server socket listen backlog is limited to 100 connections Jun 30 13:04:54.849724 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: your mercy for graceful operations on workers is 90 seconds Jun 30 13:04:54.850118 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 13:04:54.850118 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: *** Operational MODE: preforking *** Jun 30 13:04:54.858372 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: *** uWSGI is running in multiple interpreter mode *** Jun 30 13:04:54.858372 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: spawned uWSGI master process (pid: 117816) Jun 30 13:04:54.858372 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: spawned uWSGI worker 1 (pid: 117825, cores: 1) Jun 30 13:04:54.858372 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: spawned uWSGI worker 2 (pid: 117826, cores: 1) Jun 30 13:04:54.858372 dv-cinder-812685-14-iscsi devstack@n-api.service[117816]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 13:04:54.850551 dv-cinder-812685-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 13:04:55.505793 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 13:04:55.511925 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 13:04:56.691771 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 13:04:56.691771 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: from cryptography.utils import int_from_bytes Jun 30 13:04:56.692457 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 13:04:56.692457 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: from cryptography.utils import int_from_bytes Jun 30 13:04:56.705596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 13:04:56.705596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: from cryptography.utils import int_from_bytes Jun 30 13:04:56.706132 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 13:04:56.706132 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: from cryptography.utils import int_from_bytes Jun 30 13:04:59.064141 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 13:04:59.064838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 13:04:59.064942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 13:04:59.065284 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 13:04:59.065537 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 13:04:59.065925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.066251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.066590 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.066906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.067243 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.067557 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.067940 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.068255 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.068621 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.068841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.069153 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.069477 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-14-iscsi {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.069799 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.070104 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.070431 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.070757 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.071062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.071384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.071690 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.072197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.072650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.072965 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.073276 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.073617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.073927 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.074240 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.074577 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.074887 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.075207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.075514 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.075942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-14-iscsi {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.076246 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.076559 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.076872 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.077291 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.077604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.077905 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.078233 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.078569 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.078874 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.079222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.079538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.079852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.080169 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.080473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.080776 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.081089 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.081404 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.081704 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.082004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.082254 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.082585 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.082910 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.083571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.083571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.083893 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.084164 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.084511 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.088634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.088634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.088634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.088634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.088634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.088634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.088634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.088634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.089659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.089659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.089659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.089659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.089659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.089659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.089659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.090310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.090310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.090310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.090720 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.090982 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.091318 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.091592 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.091900 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.092199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.092529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.092851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.093180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.093480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.093731 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.094032 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.094385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.094672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.094977 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.095278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.095583 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.095879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.096182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.096483 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.096789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.097092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.097378 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.097662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.097966 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.098267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.098595 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.099047 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.099531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.099845 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.100153 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.100461 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.100787 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.101105 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.101409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.101702 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.102203 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.102537 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.102846 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.103160 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.103464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.103768 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.104083 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.104381 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.104687 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.105002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.105305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.105607 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.105907 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.106207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.106530 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.106835 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.107137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.107439 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.107735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.108051 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.108370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.108676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.108980 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.109285 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.109600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.109937 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.110263 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.110628 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.110943 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.111272 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.111598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.111912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.112219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.112735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.112853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.113152 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.113477 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.113770 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.114086 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.114449 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.114781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.115095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.115414 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.115731 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.116038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.116353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.116677 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.116996 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.117303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.117641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.117989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.118305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.118773 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.119100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.119408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.119716 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.120054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.120376 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.120705 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.121014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.121309 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.121639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.121997 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.122252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.122584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.122882 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.123228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.123369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 13:04:59.123789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.123873 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 13:04:59.123951 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.124135 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.124293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 13:04:59.125026 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.125137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 13:04:59.125137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 13:04:59.125288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.125288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.125429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.125506 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.125577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.125645 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.125721 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.125930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.126068 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.126238 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.126405 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.126566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.126700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.126855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.126971 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.127169 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.127271 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.127491 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.127581 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.127746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.127830 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.128057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.128148 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.128457 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-14-iscsi {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.128568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.128662 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.128741 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.128969 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.129054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.129278 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.129362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.129573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.129664 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.129870 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.129953 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.130229 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.130353 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.130558 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.130643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.131061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.131153 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.131394 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.131502 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.131676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.131759 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.131977 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.132079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.132298 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.132408 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.132599 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.132694 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.132901 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.133011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.133198 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.133301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.133508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.133603 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.133820 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.133924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.134124 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.134218 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.134464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.134574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-14-iscsi {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.134780 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.134884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.135094 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.135188 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.135425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.135526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.135742 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.135846 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.136046 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.136144 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.136368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.136459 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.136691 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.136790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.137002 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.137098 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.137300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.137389 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.137607 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.137783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.137939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.138083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.138235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.138493 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.138730 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.138879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.139028 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.139169 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.139317 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.139468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.139621 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.139762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.139904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.140054 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.140204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.140368 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.140528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.140677 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.140677 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.140944 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.141091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.141243 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.141392 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.141630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.141777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.141918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.142066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.142223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.142508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.142665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.142814 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.142959 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.143116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.143283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.143519 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.143672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.143812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.143966 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.144124 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.144278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.144442 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.144590 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.144742 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.144742 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.145016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.145171 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.145312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.145452 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.145606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.145803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.146148 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.146306 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.146509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.146661 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.146801 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.146948 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.147090 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.147244 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.147385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.147526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.147685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.147685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.147960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.147960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.148235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.148398 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.148546 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.148713 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.148936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.149092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.149233 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.149382 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.149534 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.149676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.149827 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.149975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.150116 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.150262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.150446 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.150595 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.150793 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.150962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.151117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.151271 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.151430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.151609 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.151832 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.152018 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.152178 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.152325 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.152497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.152732 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.152884 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.153038 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.153193 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.153347 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.153522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.153776 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.153936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.154083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.154236 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.154415 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.154577 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.154744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.154904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.155052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.155206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.155359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.155359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.155646 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.155793 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.155938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.156092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.156246 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.156418 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.156573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.156721 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.156883 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.157036 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.157183 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.157342 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.157489 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.157635 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.157789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.157943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.158090 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.158250 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.158451 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.158451 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.158754 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.158944 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.159165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.159330 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.159493 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.159648 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.159810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.159958 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.160104 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.160252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.160397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.160552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.161365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.161555 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.161713 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.161960 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.162115 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.162278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.162466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.162617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.162881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.163042 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.163198 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.163356 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.163511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.163658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.163917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.164075 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.164222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.164448 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.164604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.164761 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.164909 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.165235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.165397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.165564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.165719 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.165868 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.166013 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.166173 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.166360 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.166526 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.166675 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.166821 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.166967 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.167112 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.167267 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.167415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.167560 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.167706 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.167852 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.168014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.168185 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.168338 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.168486 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.168633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.168786 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.168933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.169093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.169337 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.169491 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 13:04:59.169638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.169791 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.169949 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.170116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.170265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.170469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.170627 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.170782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.170941 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.171096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.171245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.171399 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.171553 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.171699 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.171909 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.172157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.172328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.172477 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.172635 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.172800 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.173039 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.173193 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.173339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.173496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.173644 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.174808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.174977 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.175135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.175135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.175625 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.175777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.175938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.176093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.176249 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.176419 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.176568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.176715 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.176868 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.177108 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.177263 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.177419 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.177584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.177743 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.177899 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.178047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.178193 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.178371 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.178535 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.178684 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.178838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.178988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.179134 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.179287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.179533 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.179695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.179842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.179989 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.180144 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.180344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.180496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.180643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.180790 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.180936 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.181097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.181245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.181391 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.181549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.181708 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.181855 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.182010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.182010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.182419 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.182575 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.182730 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.182889 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.183062 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.183278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.183430 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.183576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.183741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.183889 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.184050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.184198 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.184198 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.184491 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.184639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.184816 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.185061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.185212 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.185212 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.185508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.185655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.185820 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.185968 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.186122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.186270 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.186503 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.186652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.186807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.186963 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.187112 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.187259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.187411 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.187567 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.187723 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.187883 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.188037 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.188186 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.188339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.188500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.188654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.188808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.188969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.189126 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.189275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.189429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.189659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.189811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.189978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.190125 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.190283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.190473 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.190622 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.190768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.190913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.191065 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.191212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.191381 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.191530 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.191676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.191842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.191996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.192157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.192313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.192584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.192786 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.192944 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.193091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.193269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.193485 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.193643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.193790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.193936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.194096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.194357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.194513 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.194670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.194825 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.194980 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.195242 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.195409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.195559 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.195714 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.195862 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.196010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.196165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.196340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.196493 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.196639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.196793 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.196948 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.197103 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.197252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.197398 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.197545 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.197699 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.197853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.198014 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.198170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.198170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.198556 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.198705 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.198852 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.199011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.199169 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.199324 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.199471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.199471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.199853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.199853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.200145 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.200310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.200458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.200612 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.200769 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.200916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.201071 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.201217 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.201363 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.201509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.201670 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.201829 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.201984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.202132 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.202296 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.202464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.202716 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.202871 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.203027 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.203183 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.203331 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.203510 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.203726 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.203877 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.204043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.204204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.204361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.204529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.204677 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.204831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.204981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.205135 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.205387 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.205554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.205711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.205866 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.206015 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.206162 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.206354 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.206516 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.206684 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.206831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.206979 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.207133 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.207295 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.207443 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.207599 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.207753 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.207907 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.208055 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.208261 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.208422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.208570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.208727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.208875 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.209021 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.209181 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.209328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.209483 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.209638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.209785 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.210027 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.210182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.210371 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.210536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.210685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.210843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.210998 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.211146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.211300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.211462 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.211618 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.211772 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.211933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.212088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.212244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.212399 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.212554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.212729 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.212969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.213121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.213270 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.213433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.213684 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.213928 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.214484 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.214641 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.214800 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.214949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.215102 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.215260 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.215419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.215573 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.215870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.216022 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.216181 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.216345 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.216506 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.216654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.216800 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.216952 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.217107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.217264 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.217411 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.217569 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.217723 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.217871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.218016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.218173 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.218352 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.218519 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.218667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.218814 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.218968 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.219116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.219263 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.219420 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.219568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.219724 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.219919 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.220157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.220316 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.220471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.220620 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.220766 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.220925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.221080 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.221235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.221389 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.221594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.221748 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.221911 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.222059 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.222206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.222435 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.222589 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.222745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.222893 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.223130 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.223130 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.223425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.223572 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.223739 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.223944 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.224161 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.224319 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.224474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.224629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.224785 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.224934 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.225080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.225242 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.225398 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.225545 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.225736 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.225924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.226163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.226354 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.226508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.226668 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.226815 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.226970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.227117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.227264 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.227417 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.227645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.227797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.227958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.228118 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.228274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.228422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.228577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.228724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.228879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.228879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.229160 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.229307 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.229465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.229613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.229759 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.229922 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.230071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.230313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.230498 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.230655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.230803 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.230949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.231095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.231250 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.231397 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.231554 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.231702 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.231848 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.232011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.232173 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.232329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.232477 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.232631 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.232779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.232925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.233085 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.233335 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.233488 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.233634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.233782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.233942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.234101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.234345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.234501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.234647 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.234795 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.235010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.235010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.235293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.235440 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.235586 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.235740 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.235901 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.236075 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.236328 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.236480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.236635 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.236791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.236954 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.237110 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.237263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.237418 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.237575 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.237736 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.237884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.238031 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.238202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.238408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.238571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.238719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.238873 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.239027 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.239183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.239339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.239549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.239710 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.239865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.240020 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.240176 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.240972 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.241147 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.241308 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.241472 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.241622 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.241779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.241936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.242084 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.242231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.242412 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.242573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.242737 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.242900 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.243060 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.243208 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.243466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.243621 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.243785 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.243942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.244090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.244237 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.244484 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.244648 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.244805 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.244805 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.245093 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.245255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.245409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.245566 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.245715 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.245869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.246032 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.246188 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.246527 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.246701 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.246860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.247016 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.247172 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.247339 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.247495 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.247652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.247807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.247963 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.248111 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.248266 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.248434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.248583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.248730 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.248876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.249023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.249177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.249352 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.249508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.249657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.249804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.249951 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.250099 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.250254 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.250438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.250588 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.250734 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.250880 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.251115 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.251281 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.251441 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.251587 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.251736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.251881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.252036 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.252185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.252331 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.252485 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.252633 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.252781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.252938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.253087 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.253243 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.253390 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.253640 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.253794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.253954 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.254103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.254259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.260312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.261161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.261422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.261593 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.261747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.261910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.262060 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.262218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.262412 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.262576 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.262726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.262876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.263032 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.263191 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.263462 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.263656 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.263900 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.264060 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.264221 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.264379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.264535 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.264691 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.264847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.270592 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.270871 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.271058 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.271058 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.273721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.273910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.274159 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.274351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.274541 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.274699 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.274856 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.275005 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.275161 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.275318 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.275474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.275627 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.275627 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.275908 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.276063 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.276234 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.276394 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.276561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.276712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.276871 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.277029 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.277185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.277342 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.277497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.277653 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.277815 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.277971 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.278120 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.278269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.278467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.278626 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.278789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.278789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.279070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.279217 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.279373 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.279373 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.279676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.279825 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.279971 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.280118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.280272 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.280445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.280778 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.280934 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.281083 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.281231 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.281384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.281542 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.281697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.281849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.282009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.282165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.282343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.282511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.282658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.282817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.282965 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.283121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.283283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.283433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.283662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.283822 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.283970 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.284141 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.284368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.284530 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.284679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.284828 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.284984 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.285132 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.285288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.285438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.285593 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.285749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.285904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.286064 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.286226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.286505 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.286722 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.287001 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.287162 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.287326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.287484 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.287633 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.287789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.287943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.288089 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.288251 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.288251 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.288549 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.288709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.288866 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.289029 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.289178 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.289333 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.289481 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.289628 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.289782 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.289940 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.290089 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.290244 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.290430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.290582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.290582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.291078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.291235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.291383 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.291539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.291687 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.291835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.291996 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.292144 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.292291 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.292291 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.292585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.292585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.292895 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.293053 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.293200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.293360 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.293515 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.293694 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.293912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.294066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.294223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.294402 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.294626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.294788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.294946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.295116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.295265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.295421 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.295576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.295732 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.295881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296183 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296341 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296502 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296659 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296659 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296951 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296951 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296951 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296951 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.296951 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.297635 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.297783 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.297938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.298086 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.298248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.298470 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.298470 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.298752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.298909 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.299064 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.299227 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.299384 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.299531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.299678 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.299831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.299987 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.300137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.300292 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.300440 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.300587 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.300747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.301127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.301292 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.301448 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.301597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.301747 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.302087 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.302269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.302455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.302606 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.302754 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.302909 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.303065 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.303222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.303382 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.303540 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.303696 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.303696 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.304075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.304229 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.304377 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.304525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.304768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.304929 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.305087 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.305235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.305449 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.305598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.305753 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.305904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.306064 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.306213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.306388 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.306556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.306713 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.306861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.307030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.307187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.307342 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.307507 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.307664 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.307825 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.307975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.308122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.308277 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.308426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.308573 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.308573 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.308959 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.309107 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.309254 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.309402 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.309568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.309725 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.309875 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.310031 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.310178 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.310383 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.310548 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.310704 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.310860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.311040 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.311349 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.311505 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.311672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.311829 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.311978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.312133 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.312280 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.312436 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.312598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.312747 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.312895 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.313041 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.313196 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.313344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.313500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.313659 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.313806 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.313955 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.314181 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.314456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.314619 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.314783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.315001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.315161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.315309 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.315472 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.315619 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.315774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.315933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.316082 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.316236 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.316476 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.316628 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.316783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.316931 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.317079 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.317225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.317387 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.317556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.317712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.317879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.318028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.318189 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.318376 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.318530 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.318687 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.318835 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.318993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.319150 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.319299 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.319447 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.319594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.319746 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.319908 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.320068 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.320218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.320364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.320510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.320664 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.320821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.320975 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.321130 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.321368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.321627 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.321781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.321953 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.322110 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.322265 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.322440 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.323202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.323367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.323527 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.323676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.323833 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.323981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.324136 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.324393 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.324548 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.324548 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.324849 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.325026 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.325255 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.325407 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.325563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.325563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.325865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.326014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.326163 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.326309 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.326497 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.326647 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.326810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.326959 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.327106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.327260 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.327410 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.327566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.327721 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.327883 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.328039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.328187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.328352 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.328509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.328659 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.328805 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.328960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.329108 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.329255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.329410 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.329565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.329721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.329880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.330037 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.330194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.330421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.330587 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.330744 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.330903 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.331051 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.331213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.331399 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.331642 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.331891 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.332050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.332199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.332356 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.332503 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.332661 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.332818 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.332966 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.333112 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.333323 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.333481 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.333630 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.333785 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.333934 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.334088 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.334245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.334497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.334653 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.334811 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.334960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.335118 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.335118 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.335511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.335671 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.335821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.335969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.336130 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.336279 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.336443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.336842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337238 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337324 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337495 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337586 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337684 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337869 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.337959 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.338091 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.338209 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.338404 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.338529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.338650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.338768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.338886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.339019 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.339490 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.339620 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.339721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.339816 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.339908 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340005 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340134 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340225 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340402 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340578 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340854 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.340939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341124 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341216 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341390 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341723 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341811 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.341910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342548 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342659 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342756 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.342936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343199 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343289 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343452 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343695 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343867 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.343970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344148 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344230 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344319 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344605 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344697 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344975 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.344975 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 13:04:59.345127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.345874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.346583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.346583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.346583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.346583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.346583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.346583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.346583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.346583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.347898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.348521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.348521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.348521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.348521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.348521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.348521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.348521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.348521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.349679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.350830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.351426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.351426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.351426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.351426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.351426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.351426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.351426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.351426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.352752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.353336 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.353336 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.353495 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.353816 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.354157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.354528 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.354852 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.355155 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.355458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.355762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.356066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.356381 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.356686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.356988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.357288 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.357594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.357895 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.358193 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.358523 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.358822 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.359126 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.359421 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.359720 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.360016 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.360313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.360609 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.360905 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.361208 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.361589 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.361943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.362244 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.362635 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.362958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.363338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.363665 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.363977 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.364298 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.364719 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.365181 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.365340 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.365658 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.365975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.366287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.366617 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.366945 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.367250 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.367556 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.367862 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.368166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.368475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.368779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.369274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.369596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.369898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.370216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.370559 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.370874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.371185 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.371490 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.371819 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.372119 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.372421 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.372732 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.373035 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.373340 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.373651 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.373961 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.374280 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.375243 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.375243 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.375243 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.375596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.375920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.376325 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.376669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.376991 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.377303 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.377610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.377911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 13:04:59.378149 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 13:04:59.380082 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Registered counter for database nova_api Jun 30 13:04:59.400676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:04:59.407284 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:04:59.439944 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO dbcounter [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Registered counter for database nova_api Jun 30 13:04:59.460445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_db.sqlalchemy.engines [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:04:59.463797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.context [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc35a938-b727-4fea-a6e5-cd9d9ebc6a61(cell1) {{(pid=117825) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 13:04:59.468068 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writer thread running {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:04:59.468271 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:04:59.469852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:04:59.470659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:04:59.472615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:04:59.474699 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Registered counter for database nova_cell0 Jun 30 13:04:59.478740 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Registered counter for database nova_cell1 Jun 30 13:04:59.486022 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:04:59.487761 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:04:59.495281 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:04:59.496573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:04:59.525610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.context [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc35a938-b727-4fea-a6e5-cd9d9ebc6a61(cell1) {{(pid=117826) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 13:04:59.529746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:04:59.531340 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:04:59.532110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:04:59.534060 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:04:59.536528 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO dbcounter [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Registered counter for database nova_cell0 Jun 30 13:04:59.540502 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO dbcounter [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Registered counter for database nova_cell1 Jun 30 13:04:59.547625 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_db.sqlalchemy.engines [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:04:59.549921 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_db.sqlalchemy.engines [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:04:59.554572 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writer thread running {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:04:59.560252 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writer thread running {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:04:59.642402 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO dbcounter [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Registered counter for database nova_cell0 Jun 30 13:04:59.649329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_db.sqlalchemy.engines [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:04:59.653876 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writer thread running {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:04:59.702897 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO dbcounter [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Registered counter for database nova_cell0 Jun 30 13:04:59.710192 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_db.sqlalchemy.engines [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 13:04:59.715424 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writer thread running {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 13:04:59.967859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 13:04:59.975204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 13:05:00.062016 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: WARNING keystonemiddleware.auth_token [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 13:05:00.069418 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: WARNING keystonemiddleware.auth_token [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 13:05:00.316942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 13:05:00.323431 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: WARNING keystonemiddleware.auth_token [None req-cf65ddbb-0cbf-4514-90ba-6f5b7f2ca561 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 13:05:00.328987 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55922048a9c0 pid: 117825 (default app) Jun 30 13:05:00.419436 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: WARNING keystonemiddleware.auth_token [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 13:05:00.425416 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: WARNING keystonemiddleware.auth_token [None req-c6367d84-a861-45b3-aaff-af007db8bfba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 13:05:00.430950 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55922048a9c0 pid: 117826 (default app) Jun 30 13:05:41.855525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.857988 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.859242 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.860415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:42.133039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:42.139367 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:42.141445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:42.142203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:43.154566 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3edb625c-ff44-4f8d-9ee4-d5c6e93675cf tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Action: 'create', calling method: .version_select at 0x7f4ba57ef430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-911660399", "metadata": {"Type": "work"}}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3edb625c-ff44-4f8d-9ee4-d5c6e93675cf tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Request method failure captured: Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 121 Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-lSS9ux18HATmrHE6qeIAftwaClzyDg4y0o6_TW-P_4wNs9WudxRMabukZZq_GiXhm8mbTxFbVtz-_qRfiM5ePl0liSowXkxGg0MBbnh-HwAk0jZsNC0ABQy7-OHEK1qYpKY92nJYJiwTySzqELWsVCUPIPavGPcxfktAzdrQUi6w Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:05:43.173313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}] Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: f9383bc17a254fe69d495478dd47230c Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-911660399", "metadata": {"Type": "work"}}} Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: Jun 30 13:05:43.175910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-911660399', 'metadata': {'Type': 'work'}}}} Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise error Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:43.177279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 13:05:43.178788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 13:05:43.180198 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 13:05:43.180198 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.181641 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3edb625c-ff44-4f8d-9ee4-d5c6e93675cf tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:43.182816 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3edb625c-ff44-4f8d-9ee4-d5c6e93675cf tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.070679 Jun 30 13:05:43.183869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Thu Jun 30 13:05:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1073 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 30 13:05:43.197393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e30e0a27-3a79-4759-83e7-c3b5ad6c1c24 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Action: 'create', calling method: .version_select at 0x7f4ba5803790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1297623438", "metadata": {"Type": "work"}}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e30e0a27-3a79-4759-83e7-c3b5ad6c1c24 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Request method failure captured: Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 120 Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-lSS9ux18HATmrHE6qeIAftwaClzyDg4y0o6_TW-P_4wNs9WudxRMabukZZq_GiXhm8mbTxFbVtz-_qRfiM5ePl0liSowXkxGg0MBbnh-HwAk0jZsNC0ABQy7-OHEK1qYpKY92nJYJiwTySzqELWsVCUPIPavGPcxfktAzdrQUi6w Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:05:43.205236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}] Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: f9383bc17a254fe69d495478dd47230c Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1297623438", "metadata": {"Type": "work"}}} Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: Jun 30 13:05:43.206741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1297623438', 'metadata': {'Type': 'work'}}}} Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise error Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi '0' Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:43.207533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 13:05:43.209102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 13:05:43.210194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 13:05:43.210194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.210194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e30e0a27-3a79-4759-83e7-c3b5ad6c1c24 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:43.210194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e30e0a27-3a79-4759-83e7-c3b5ad6c1c24 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015779 Jun 30 13:05:43.214117 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 2/2] 10.222.0.49 () {60 vars in 1155 bytes} [Thu Jun 30 13:05:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:05:43.227454 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1bed1306-e2b3-4641-aba8-27efabf39daa tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Action: 'create', calling method: .version_select at 0x7f4ba57ef790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1755932886", "metadata": {"Type": "work"}}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1bed1306-e2b3-4641-aba8-27efabf39daa tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Request method failure captured: Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 119 Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-lSS9ux18HATmrHE6qeIAftwaClzyDg4y0o6_TW-P_4wNs9WudxRMabukZZq_GiXhm8mbTxFbVtz-_qRfiM5ePl0liSowXkxGg0MBbnh-HwAk0jZsNC0ABQy7-OHEK1qYpKY92nJYJiwTySzqELWsVCUPIPavGPcxfktAzdrQUi6w Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:05:43.234761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}] Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: f9383bc17a254fe69d495478dd47230c Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1755932886", "metadata": {"Type": "work"}}} Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: Jun 30 13:05:43.236131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1755932886', 'metadata': {'Type': 'work'}}}} Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise error Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi '' Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:43.236881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 13:05:43.238122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 13:05:43.240249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 13:05:43.240249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.240249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1bed1306-e2b3-4641-aba8-27efabf39daa tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:43.240249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1bed1306-e2b3-4641-aba8-27efabf39daa tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020939 Jun 30 13:05:43.242472 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 3/3] 10.222.0.49 () {60 vars in 1155 bytes} [Thu Jun 30 13:05:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:05:43.255445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-610ceb34-1cd1-46f7-9709-97dcafe09ec3 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Calling method '.version_select at 0x7f4ba569d430>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:43.360404 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4ca89ebc-0236-4d40-9cac-f4c4b2f7d7a6 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Action: 'create', calling method: .version_select at 0x7f4ba57f03a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-323014026"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:43.786352 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-610ceb34-1cd1-46f7-9709-97dcafe09ec3 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] HTTP exception thrown: Volume tempest-invalid-53952649 could not be found. Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-610ceb34-1cd1-46f7-9709-97dcafe09ec3 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Request method failure captured: Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-53952649 HTTP/1.1 Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-lSS9ux18HATmrHE6qeIAftwaClzyDg4y0o6_TW-P_4wNs9WudxRMabukZZq_GiXhm8mbTxFbVtz-_qRfiM5ePl0liSowXkxGg0MBbnh-HwAk0jZsNC0ABQy7-OHEK1qYpKY92nJYJiwTySzqELWsVCUPIPavGPcxfktAzdrQUi6w Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:05:43.791784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}] Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: f9383bc17a254fe69d495478dd47230c Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Volume tempest-invalid-53952649 could not be found. Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': 'tempest-invalid-53952649'} Jun 30 13:05:43.793481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-53952649 could not be found. (HTTP 404) (Request-ID: req-a2551452-a5cf-45b7-b483-4dc2caf8a042) Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.794422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 13:05:43.795857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-53952649 could not be found. Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:05:43.798555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-53952649 could not be found. Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-53952649 could not be found. Jun 30 13:05:43.800930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.803539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-610ceb34-1cd1-46f7-9709-97dcafe09ec3 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Returning 404 to user: Volume tempest-invalid-53952649 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:43.804793 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-610ceb34-1cd1-46f7-9709-97dcafe09ec3 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-53952649" status: 404 len: 97 microversion: 2.1 time: 0.557734 Jun 30 13:05:43.806962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 4/4] 10.222.0.49 () {58 vars in 1211 bytes} [Thu Jun 30 13:05:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-53952649 => generated 97 bytes in 560 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 30 13:05:43.819811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0735e1c0-3641-43a8-b60f-697a47e6a112 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006078 Jun 30 13:05:43.824708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 5/5] 10.222.0.49 () {58 vars in 1139 bytes} [Thu Jun 30 13:05:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 13:05:43.829812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0c175e42-1ae4-4843-90dc-eb3303842263 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003513 Jun 30 13:05:43.834839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 6/6] 10.222.0.49 () {58 vars in 1136 bytes} [Thu Jun 30 13:05:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 13:05:43.840550 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9b4e0c23-c28f-4998-b4cd-b5af133a5c99 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Calling method '.version_select at 0x7f4ba5647820>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:43.895749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-9b4e0c23-c28f-4998-b4cd-b5af133a5c99 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] HTTP exception thrown: Volume 03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 could not be found. Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9b4e0c23-c28f-4998-b4cd-b5af133a5c99 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Request method failure captured: Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/os-volumes/03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 HTTP/1.1 Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-lSS9ux18HATmrHE6qeIAftwaClzyDg4y0o6_TW-P_4wNs9WudxRMabukZZq_GiXhm8mbTxFbVtz-_qRfiM5ePl0liSowXkxGg0MBbnh-HwAk0jZsNC0ABQy7-OHEK1qYpKY92nJYJiwTySzqELWsVCUPIPavGPcxfktAzdrQUi6w Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:05:43.901985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}] Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: f9383bc17a254fe69d495478dd47230c Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Volume 03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 could not be found. Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5'} Jun 30 13:05:43.903379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 could not be found. (HTTP 404) (Request-ID: req-16818d88-e557-40cc-a424-04f1cbf22476) Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.904137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 13:05:43.906984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 could not be found. Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 13:05:43.908313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 could not be found. Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 could not be found. Jun 30 13:05:43.909663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:43.912317 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9b4e0c23-c28f-4998-b4cd-b5af133a5c99 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Returning 404 to user: Volume 03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:43.915305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9b4e0c23-c28f-4998-b4cd-b5af133a5c99 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5" status: 404 len: 109 microversion: 2.1 time: 0.076909 Jun 30 13:05:43.921316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 7/7] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:05:43 2022] DELETE /compute/v2.1/os-volumes/03b7ddd1-e492-42bf-b8a1-94ba4c65d7b5 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:05:43.931279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6fa6ff02-dd06-4ec8-9132-1821061268b2 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Calling method '.version_select at 0x7f4ba5803ca0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:44.003377 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-6fa6ff02-dd06-4ec8-9132-1821061268b2 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] HTTP exception thrown: Volume fb23ef32-a938-4d7a-9116-6f93233c9c41 could not be found. Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6fa6ff02-dd06-4ec8-9132-1821061268b2 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Request method failure captured: Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/os-volumes/fb23ef32-a938-4d7a-9116-6f93233c9c41 HTTP/1.1 Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-lSS9ux18HATmrHE6qeIAftwaClzyDg4y0o6_TW-P_4wNs9WudxRMabukZZq_GiXhm8mbTxFbVtz-_qRfiM5ePl0liSowXkxGg0MBbnh-HwAk0jZsNC0ABQy7-OHEK1qYpKY92nJYJiwTySzqELWsVCUPIPavGPcxfktAzdrQUi6w Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:05:44.006447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_faccee69d2444c61bb9bedff14fe9a25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/faccee69d2444c61bb9bedff14fe9a25"}]}] Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: faccee69d2444c61bb9bedff14fe9a25 Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-VolumesNegativeTest-1574878953 Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: f9383bc17a254fe69d495478dd47230c Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-VolumesNegativeTest-1574878953-project Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Volume fb23ef32-a938-4d7a-9116-6f93233c9c41 could not be found. Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': 'fb23ef32-a938-4d7a-9116-6f93233c9c41'} Jun 30 13:05:44.007718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb23ef32-a938-4d7a-9116-6f93233c9c41 could not be found. (HTTP 404) (Request-ID: req-6478dcb9-a379-465e-aacb-5e017d08f417) Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:44.008464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:05:44.009585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb23ef32-a938-4d7a-9116-6f93233c9c41 could not be found. Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 13:05:44.012837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb23ef32-a938-4d7a-9116-6f93233c9c41 could not be found. Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb23ef32-a938-4d7a-9116-6f93233c9c41 could not be found. Jun 30 13:05:44.016189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:05:44.019741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6fa6ff02-dd06-4ec8-9132-1821061268b2 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] Returning 404 to user: Volume fb23ef32-a938-4d7a-9116-6f93233c9c41 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:44.021347 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6fa6ff02-dd06-4ec8-9132-1821061268b2 tempest-VolumesNegativeTest-1574878953 tempest-VolumesNegativeTest-1574878953-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fb23ef32-a938-4d7a-9116-6f93233c9c41" status: 404 len: 109 microversion: 2.1 time: 0.097082 Jun 30 13:05:44.022626 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 8/8] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:43 2022] GET /compute/v2.1/os-volumes/fb23ef32-a938-4d7a-9116-6f93233c9c41 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 13:05:44.433654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4ca89ebc-0236-4d40-9cac-f4c4b2f7d7a6 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.594905 Jun 30 13:05:44.440904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 1/9] 10.222.0.49 () {60 vars in 1154 bytes} [Thu Jun 30 13:05:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2598 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 13:05:44.449865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7c5aeb01-c6b3-4c80-b339-5a1b880202dd tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56471f0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:44.558686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7c5aeb01-c6b3-4c80-b339-5a1b880202dd tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136" status: 200 len: 344 microversion: 2.1 time: 0.114644 Jun 30 13:05:44.559499 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 9/10] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:44 2022] GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:45.533527 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7974f9b9-36b3-41d5-875a-0d5e5e71f182 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba56c5280>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:45.571688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bd8a42d6-b921-4201-9950-669db159e798 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba5803c10>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:45.621846 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7974f9b9-36b3-41d5-875a-0d5e5e71f182 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/fb7491a3-d076-49cc-b0be-2347968fec87" status: 200 len: 351 microversion: 2.1 time: 0.095724 Jun 30 13:05:45.636344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 2/11] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:45 2022] GET /compute/v2.1/os-volumes/fb7491a3-d076-49cc-b0be-2347968fec87 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:45.666208 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bd8a42d6-b921-4201-9950-669db159e798 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136" status: 200 len: 345 microversion: 2.1 time: 0.098199 Jun 30 13:05:45.666821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 10/12] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:45 2022] GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:45.681321 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d460f837-abb9-4995-9eb5-289dd57828e3 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Action: 'create', calling method: .version_select at 0x7f4ba56c58b0>, body: {"snapshot": {"volume_id": "2c3deaab-506a-4a2d-bab0-58e325aa8136", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1382054770"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:46.143617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d460f837-abb9-4995-9eb5-289dd57828e3 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.468340 Jun 30 13:05:46.144723 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 3/13] 10.222.0.49 () {60 vars in 1161 bytes} [Thu Jun 30 13:05:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:46.154615 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-725e307c-5a4b-455e-a81e-7b57bd916bd7 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56475e0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:46.214671 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-725e307c-5a4b-455e-a81e-7b57bd916bd7 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 287 microversion: 2.1 time: 0.063343 Jun 30 13:05:46.215523 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 11/14] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:46 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:46.225881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fba5730d-ddd0-40a3-9e99-b1f40e4c71f7 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56c5ee0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:46.425450 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fba5730d-ddd0-40a3-9e99-b1f40e4c71f7 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.203092 Jun 30 13:05:46.426581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 4/15] 10.222.0.49 () {58 vars in 1139 bytes} [Thu Jun 30 13:05:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:46.437262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3921295d-d1b9-4615-ba22-15e651f083f8 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba5647af0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:46.496665 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3921295d-d1b9-4615-ba22-15e651f083f8 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 287 microversion: 2.1 time: 0.063236 Jun 30 13:05:46.497779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 12/16] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:46 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:47.509363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8fc94391-cf4b-4a1d-bad8-76f3074e1516 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56cec10>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:47.637924 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8fc94391-cf4b-4a1d-bad8-76f3074e1516 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 287 microversion: 2.1 time: 0.132703 Jun 30 13:05:47.639072 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 5/17] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:47 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:48.652515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e685ffba-b7b6-468f-8d7c-0f8766bd6efb tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba5658550>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:48.707160 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e685ffba-b7b6-468f-8d7c-0f8766bd6efb tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 287 microversion: 2.1 time: 0.060051 Jun 30 13:05:48.708262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 13/18] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:48 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:49.721130 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3303c998-9861-4e0c-bf3e-acaa68797603 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56ce790>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:49.783480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3303c998-9861-4e0c-bf3e-acaa68797603 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 287 microversion: 2.1 time: 0.067350 Jun 30 13:05:49.784052 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 6/19] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:49 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:50.796210 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b0169d8f-6c10-4248-88ba-5caa12a7dce0 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba5647430>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:50.884226 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b0169d8f-6c10-4248-88ba-5caa12a7dce0 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 287 microversion: 2.1 time: 0.091794 Jun 30 13:05:50.884784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 14/20] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:50 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:51.897138 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-44daa493-647e-4b2d-8f02-6f2c0b203e44 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56ce0d0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:51.969873 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-44daa493-647e-4b2d-8f02-6f2c0b203e44 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 287 microversion: 2.1 time: 0.077260 Jun 30 13:05:51.970918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 7/21] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:51 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:52.981525 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-91933ef1-0c99-43b7-8628-965abb5ac650 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56478b0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:53.099167 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-91933ef1-0c99-43b7-8628-965abb5ac650 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 288 microversion: 2.1 time: 0.121209 Jun 30 13:05:53.099903 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 15/22] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:52 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 288 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:53.110605 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4fb8437e-ede2-49fb-a87a-b6959ea56a67 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56c5e50>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:53.366165 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4fb8437e-ede2-49fb-a87a-b6959ea56a67 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 202 len: 0 microversion: 2.1 time: 0.259664 Jun 30 13:05:53.367933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 8/23] 10.222.0.49 () {58 vars in 1253 bytes} [Thu Jun 30 13:05:53 2022] DELETE /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:05:53.376682 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f432f499-3fe0-469a-9e64-3db4db1ad9ad tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba58039d0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:53.527453 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e16793e4-2192-4020-977f-146ce0ba5a0b tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba56c50d0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:53.614864 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f432f499-3fe0-469a-9e64-3db4db1ad9ad tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 200 len: 287 microversion: 2.1 time: 0.243448 Jun 30 13:05:53.616370 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 16/24] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:53 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 287 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:53.763200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e16793e4-2192-4020-977f-146ce0ba5a0b tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2ce1dccf-3c68-41dd-9b29-8590e7869d45" status: 200 len: 351 microversion: 2.1 time: 0.239606 Jun 30 13:05:53.764142 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 9/25] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:53 2022] GET /compute/v2.1/os-volumes/2ce1dccf-3c68-41dd-9b29-8590e7869d45 => generated 351 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:05:54.635362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fc0969f4-c253-464a-8f70-0beb1aa60bde tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56ceb80>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:54.687987 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-fc0969f4-c253-464a-8f70-0beb1aa60bde tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] HTTP exception thrown: Snapshot 6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 could not be found. Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fc0969f4-c253-464a-8f70-0beb1aa60bde tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Request method failure captured: Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 HTTP/1.1 Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-lJz0i4c1k4cdUXlUX8J5TpTPzPYCsLcaEjSKKufxdW3itY7BF7tHhirdI_AK4v6SCvLX-2P-Ltd9yq4dScPPFjChI-vAbE_4ecyPVaR2-SJxg7Tg1aZBz3b14qKCTLCPNZ3DbYkULPxYtIysdqCR4i1fAX5UH36COV84zA7TU-vE Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 34e1e9e677d14642bb533001aa8ac301 Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:05:54.693053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34e1e9e677d14642bb533001aa8ac301"}]}] Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 34e1e9e677d14642bb533001aa8ac301 Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotsTestJSON-465116257-project Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 44f56529ce40493f9f6e1da0de9cfca7 Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotsTestJSON-465116257-project Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Snapshot 6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 could not be found. Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '6d735f3b-0c98-4d13-8fc6-2ade39c24cf5'} Jun 30 13:05:54.694212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 could not be found. (HTTP 404) (Request-ID: req-41790a49-4824-4bd9-b482-8333f9efcfc9) Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:54.694930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:05:54.695928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 could not be found. Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 13:05:54.696851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 could not be found. Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 could not be found. Jun 30 13:05:54.697804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:54.703908 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fc0969f4-c253-464a-8f70-0beb1aa60bde tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Returning 404 to user: Snapshot 6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:54.704988 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fc0969f4-c253-464a-8f70-0beb1aa60bde tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5" status: 404 len: 111 microversion: 2.1 time: 0.080133 Jun 30 13:05:54.705976 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 10/26] 10.222.0.49 () {58 vars in 1250 bytes} [Thu Jun 30 13:05:54 2022] GET /compute/v2.1/os-snapshots/6d735f3b-0c98-4d13-8fc6-2ade39c24cf5 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:05:54.717141 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-55704f8b-52cd-4f82-ab43-e7dff825bc35 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba601d670>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:54.855529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-55704f8b-52cd-4f82-ab43-e7dff825bc35 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136" status: 202 len: 0 microversion: 2.1 time: 0.143229 Jun 30 13:05:54.856426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 11/27] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:05:54 2022] DELETE /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:05:54.869177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14bb6356-987d-4bd6-af80-5c45cc0b4021 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56cedc0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:54.943492 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-80fd3792-cb3c-4cc0-a920-7b9ecc9d3046 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: .version_select at 0x7f4ba5658430>, body: {"keypair": {"name": "tempest-keypair-2011138236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNs8R4XJoziREXK2srwj0j9NsVtVjgwHOGGNvUh2Qhr6nTKfeKTlVwAE4cZZrXAqpwfLzJr+d/mN8+y5anLh5OZYDLEzFXFnfeSaIfen8Kr2Kxqf01+Hlk/94a/W9B1vg=="}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:54.990887 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14bb6356-987d-4bd6-af80-5c45cc0b4021 tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136" status: 200 len: 344 microversion: 2.1 time: 0.129662 Jun 30 13:05:54.992084 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 12/28] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:54 2022] GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 => generated 344 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:55.074511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-80fd3792-cb3c-4cc0-a920-7b9ecc9d3046 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for project fb73f41e81224744800e167e0eb69863. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:05:55.106628 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-80fd3792-cb3c-4cc0-a920-7b9ecc9d3046 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for user 126e2b6fc7114ec3bdc1bb3a99fcf752 and project fb73f41e81224744800e167e0eb69863. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:05:55.191419 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-80fd3792-cb3c-4cc0-a920-7b9ecc9d3046 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.707363 Jun 30 13:05:55.193839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 17/29] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:05:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:55.671814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-812322f9-79f2-4961-a32a-65abe65ad6c4 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba56323a0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:55.841831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-812322f9-79f2-4961-a32a-65abe65ad6c4 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2f72373c-ea10-4d19-a225-a470c185b865" status: 200 len: 348 microversion: 2.1 time: 0.174177 Jun 30 13:05:55.843189 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 13/30] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:55 2022] GET /compute/v2.1/os-volumes/2f72373c-ea10-4d19-a225-a470c185b865 => generated 348 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:55.855834 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8fc3a882-17aa-4852-9ae0-62fd250d95c8 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba5612ee0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:56.004082 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-48e5ec2b-a635-4e44-8f5b-900b602fa5af tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56328b0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:56.021006 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8fc3a882-17aa-4852-9ae0-62fd250d95c8 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.169560 Jun 30 13:05:56.024118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 18/31] 10.222.0.49 () {58 vars in 1133 bytes} [Thu Jun 30 13:05:55 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:56.049561 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-54a6dd30-46ad-413f-b3ef-7a35ea72b449 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba55d6ee0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:56.074692 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-48e5ec2b-a635-4e44-8f5b-900b602fa5af tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] HTTP exception thrown: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-48e5ec2b-a635-4e44-8f5b-900b602fa5af tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Request method failure captured: Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 HTTP/1.1 Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-lJz0i4c1k4cdUXlUX8J5TpTPzPYCsLcaEjSKKufxdW3itY7BF7tHhirdI_AK4v6SCvLX-2P-Ltd9yq4dScPPFjChI-vAbE_4ecyPVaR2-SJxg7Tg1aZBz3b14qKCTLCPNZ3DbYkULPxYtIysdqCR4i1fAX5UH36COV84zA7TU-vE Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 34e1e9e677d14642bb533001aa8ac301 Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:05:56.077327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34e1e9e677d14642bb533001aa8ac301"}]}] Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 34e1e9e677d14642bb533001aa8ac301 Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotsTestJSON-465116257-project Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 44f56529ce40493f9f6e1da0de9cfca7 Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotsTestJSON-465116257-project Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '2c3deaab-506a-4a2d-bab0-58e325aa8136'} Jun 30 13:05:56.078819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. (HTTP 404) (Request-ID: req-6626b7f3-dfd9-4874-bd7d-cacae3305daa) Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.079421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:05:56.080355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 13:05:56.081228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.082211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.088169 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-48e5ec2b-a635-4e44-8f5b-900b602fa5af tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Returning 404 to user: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:56.089271 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-48e5ec2b-a635-4e44-8f5b-900b602fa5af tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136" status: 404 len: 109 microversion: 2.1 time: 0.089886 Jun 30 13:05:56.091157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 14/32] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:55 2022] GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:05:56.104286 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fae950f-86bb-4eb4-90f9-c6d05cbea15c tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56ce040>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:56.195323 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-2fae950f-86bb-4eb4-90f9-c6d05cbea15c tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] HTTP exception thrown: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fae950f-86bb-4eb4-90f9-c6d05cbea15c tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Request method failure captured: Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 HTTP/1.1 Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-lJz0i4c1k4cdUXlUX8J5TpTPzPYCsLcaEjSKKufxdW3itY7BF7tHhirdI_AK4v6SCvLX-2P-Ltd9yq4dScPPFjChI-vAbE_4ecyPVaR2-SJxg7Tg1aZBz3b14qKCTLCPNZ3DbYkULPxYtIysdqCR4i1fAX5UH36COV84zA7TU-vE Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 34e1e9e677d14642bb533001aa8ac301 Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:05:56.197367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34e1e9e677d14642bb533001aa8ac301"}]}] Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 34e1e9e677d14642bb533001aa8ac301 Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotsTestJSON-465116257-project Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 44f56529ce40493f9f6e1da0de9cfca7 Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotsTestJSON-465116257-project Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '2c3deaab-506a-4a2d-bab0-58e325aa8136'} Jun 30 13:05:56.198600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. (HTTP 404) (Request-ID: req-6d4a2835-5e11-4a47-b418-4c319c14c332) Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.199269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 13:05:56.200265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 13:05:56.201197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fae950f-86bb-4eb4-90f9-c6d05cbea15c tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Returning 404 to user: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2fae950f-86bb-4eb4-90f9-c6d05cbea15c tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136" status: 404 len: 109 microversion: 2.1 time: 0.102690 Jun 30 13:05:56.202049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 15/33] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:05:56 2022] DELETE /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:05:56.209688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f94b9856-ef1e-444e-bf27-fd52900f9c4d tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Calling method '.version_select at 0x7f4ba56324c0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:56.248873 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-54a6dd30-46ad-413f-b3ef-7a35ea72b449 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.212110 Jun 30 13:05:56.249979 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 19/34] 10.222.0.49 () {58 vars in 1148 bytes} [Thu Jun 30 13:05:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:56.262054 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b281261f-50aa-4898-937c-1a011ec13f5c tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba55d6dc0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:56.315340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-f94b9856-ef1e-444e-bf27-fd52900f9c4d tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] HTTP exception thrown: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f94b9856-ef1e-444e-bf27-fd52900f9c4d tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Request method failure captured: Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 HTTP/1.1 Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-lJz0i4c1k4cdUXlUX8J5TpTPzPYCsLcaEjSKKufxdW3itY7BF7tHhirdI_AK4v6SCvLX-2P-Ltd9yq4dScPPFjChI-vAbE_4ecyPVaR2-SJxg7Tg1aZBz3b14qKCTLCPNZ3DbYkULPxYtIysdqCR4i1fAX5UH36COV84zA7TU-vE Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 34e1e9e677d14642bb533001aa8ac301 Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:05:56.319187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_34e1e9e677d14642bb533001aa8ac301"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/34e1e9e677d14642bb533001aa8ac301"}]}] Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 34e1e9e677d14642bb533001aa8ac301 Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-465116257 Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotsTestJSON-465116257-project Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 44f56529ce40493f9f6e1da0de9cfca7 Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotsTestJSON-465116257-project Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '2c3deaab-506a-4a2d-bab0-58e325aa8136'} Jun 30 13:05:56.320231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. (HTTP 404) (Request-ID: req-421485d3-c799-44bd-86b4-d73480502ce5) Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.320838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:05:56.321693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 13:05:56.322581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f94b9856-ef1e-444e-bf27-fd52900f9c4d tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] Returning 404 to user: Volume 2c3deaab-506a-4a2d-bab0-58e325aa8136 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f94b9856-ef1e-444e-bf27-fd52900f9c4d tempest-VolumesSnapshotsTestJSON-465116257 tempest-VolumesSnapshotsTestJSON-465116257-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136" status: 404 len: 109 microversion: 2.1 time: 0.115172 Jun 30 13:05:56.323423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 16/35] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:05:56 2022] GET /compute/v2.1/os-volumes/2c3deaab-506a-4a2d-bab0-58e325aa8136 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 13:05:56.475570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b281261f-50aa-4898-937c-1a011ec13f5c tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.217592 Jun 30 13:05:56.476652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 20/36] 10.222.0.49 () {58 vars in 1133 bytes} [Thu Jun 30 13:05:56 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:05:56.489542 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-15c335aa-34df-4870-bb48-03dc5e60b4a7 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba56ce310>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:56.785475 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-15c335aa-34df-4870-bb48-03dc5e60b4a7 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.301231 Jun 30 13:05:56.786696 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 17/37] 10.222.0.49 () {58 vars in 1166 bytes} [Thu Jun 30 13:05:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:56.798808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c52d1142-e891-4bb9-bfdf-4f2b1ba417d2 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba55d6160>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:57.100678 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c52d1142-e891-4bb9-bfdf-4f2b1ba417d2 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.305483 Jun 30 13:05:57.101238 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 21/38] 10.222.0.49 () {58 vars in 1169 bytes} [Thu Jun 30 13:05:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:05:57.116501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-df4c23d6-b91a-43cb-9c92-2ace4d7f43e6 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba4d68940>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:57.253916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1194739373", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "networks": [{"uuid": "b7075ca6-6f73-48e2-a434-3959d128a164"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:57.402689 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-df4c23d6-b91a-43cb-9c92-2ace4d7f43e6 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.292071 Jun 30 13:05:57.403840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 22/39] 10.222.0.49 () {58 vars in 1154 bytes} [Thu Jun 30 13:05:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:57.414964 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ac3e51f2-e9f7-4316-ba21-97011e6fd684 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba4d68d30>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:57.589007 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] validate_networks() for [('b7075ca6-6f73-48e2-a434-3959d128a164', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:05:57.642939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ac3e51f2-e9f7-4316-ba21-97011e6fd684 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.231362 Jun 30 13:05:57.644055 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 23/40] 10.222.0.49 () {58 vars in 1187 bytes} [Thu Jun 30 13:05:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:05:57.740100 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4046693f-dfe6-4548-9199-ab9afd74b1e1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'create', calling method: .version_select at 0x7f4ba5612af0>, body: {"keypair": {"name": "tempest-keypair-531342311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHuFWXw/cD4MayekFPJ2X3F4YOL+Y50Wurz9JZvl6IGcQZZ5RxjW+2IxLq3MsTVQgroLce0M+dplK1p+stIKKnnKNidNWU1lymMys6ZG1l8fk2I6uTyccXeZxx2B/RXXw=="}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:57.767627 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-4046693f-dfe6-4548-9199-ab9afd74b1e1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Getting quotas for project cee8ced67bdf4b5ca8aa12a8940b9bea. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:05:57.775377 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-4046693f-dfe6-4548-9199-ab9afd74b1e1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Getting quotas for user e5e99d5484594d13b113f27e77b37efd and project cee8ced67bdf4b5ca8aa12a8940b9bea. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:05:57.817326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4046693f-dfe6-4548-9199-ab9afd74b1e1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.169996 Jun 30 13:05:57.819750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 24/41] 10.222.0.49 () {62 vars in 1199 bytes} [Thu Jun 30 13:05:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 13:05:57.835033 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-74d6a4c6-095b-4c89-9cf3-12d92ec1e356 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] Calling method '.version_select at 0x7f4ba55d6430>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:05:57.943467 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-74d6a4c6-095b-4c89-9cf3-12d92ec1e356 tempest-VolumesTestJSON-2072738122 tempest-VolumesTestJSON-2072738122-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.120604 Jun 30 13:05:57.944246 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 25/42] 10.222.0.49 () {58 vars in 1154 bytes} [Thu Jun 30 13:05:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:05:59.756893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7f9d6f54-091d-42fb-b118-1c5b9b9887f2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'create', calling method: .version_select at 0x7f4ba4d68af0>, body: {"keypair": {"name": "tempest-keypair-2093773867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVLTi8Oo3zKZJGkgY5sDl/pE1KV4/EuJsZiw7Q/Yez6dBk8uDXbBKPnJUlKsxZmYd5jTajOorheQnFWf5TMC1LuSAI3gJx9eyO5QJEJ4zKyVgZfrAiHZVB2tNKe+KxW7Q=="}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:05:59.789828 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-7f9d6f54-091d-42fb-b118-1c5b9b9887f2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Getting quotas for project 2671e576de2c44e6b1f5df7c53aae76a. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:05:59.803569 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-7f9d6f54-091d-42fb-b118-1c5b9b9887f2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Getting quotas for user e0df4b789a804a00a267bcc5cf778324 and project 2671e576de2c44e6b1f5df7c53aae76a. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:05:59.867735 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7f9d6f54-091d-42fb-b118-1c5b9b9887f2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.856080 Jun 30 13:05:59.868354 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 26/43] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:05:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:05:59.893589 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:05:59.894845 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:05:59.895814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:05:59.896861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:05:59.897899 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:05:59.938434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:05:59.940430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:05:59.944663 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:05:59.945362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:00.043548 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Getting quotas for project 988a6aa0bbb045bb9b66810219206ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:06:00.066136 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Getting quotas for user 2e84715279114df09ecfe4335c926066 and project 988a6aa0bbb045bb9b66810219206ebc. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:06:00.103891 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:06:00.107826 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:06:00.191715 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-625417444", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2789cdc0-70d1-47d5-9191-eacc6cd13622"}], "security_groups": [{"name": "tempest-securitygroup--1633511659"}], "key_name": "tempest-keypair-2011138236", "user_data": "}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:00.370731 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e8bf1c2-b44d-4a79-9eb6-5a0499a2fae8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.468576 Jun 30 13:06:00.374693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 18/44] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:05:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:06:00.388828 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-133d754a-feba-452a-8919-e18f7ef9bf0b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:00.401581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-133d754a-feba-452a-8919-e18f7ef9bf0b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:00.732100 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] validate_networks() for [('2789cdc0-70d1-47d5-9191-eacc6cd13622', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:06:00.975542 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-133d754a-feba-452a-8919-e18f7ef9bf0b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:01.009830 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-133d754a-feba-452a-8919-e18f7ef9bf0b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1215 microversion: 2.1 time: 0.624662 Jun 30 13:06:01.011575 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 19/45] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:00 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1215 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:01.450046 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f7c813d8-0696-4f83-b42b-a703abe9d86f tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Action: 'create', calling method: .version_select at 0x7f4ba4d3a040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1485333814", "metadata": {"Type": "work"}}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:02.403999 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f7c813d8-0696-4f83-b42b-a703abe9d86f tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.385165 Jun 30 13:06:02.415777 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 20/46] 10.222.0.49 () {60 vars in 1155 bytes} [Thu Jun 30 13:06:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 13:06:02.422228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0624dbc-62a3-48e2-89d0-2ceda93055a8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:02.423232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0624dbc-62a3-48e2-89d0-2ceda93055a8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:02.633132 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:06:02.634700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:06:02.635354 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:06:02.638142 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:06:02.639712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:06:02.640525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0624dbc-62a3-48e2-89d0-2ceda93055a8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:02.655214 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0624dbc-62a3-48e2-89d0-2ceda93055a8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1215 microversion: 2.1 time: 0.235191 Jun 30 13:06:02.661879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 21/47] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:02 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:02.676821 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c27a0cc-2b0b-44e8-b93d-16f668012b4d tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Calling method '.version_select at 0x7f4ba4d2ad30>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:02.679732 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:02.680173 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:02.680957 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:02.681382 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:02.788350 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for project fb73f41e81224744800e167e0eb69863. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:06:02.812106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for user 126e2b6fc7114ec3bdc1bb3a99fcf752 and project fb73f41e81224744800e167e0eb69863. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:06:02.826514 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c27a0cc-2b0b-44e8-b93d-16f668012b4d tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9" status: 200 len: 353 microversion: 2.1 time: 0.161151 Jun 30 13:06:02.827163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 22/48] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:06:02 2022] GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:02.848812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:06:02.867430 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:06:03.136949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-60ac4c35-fe3a-4143-91fa-7c716a308fb6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.950633 Jun 30 13:06:03.142407 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 27/49] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:06:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 13:06:03.148517 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-738e8327-679f-4518-adab-cfa07115ca7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:03.149148 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-738e8327-679f-4518-adab-cfa07115ca7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:03.365329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-738e8327-679f-4518-adab-cfa07115ca7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:03.382596 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-738e8327-679f-4518-adab-cfa07115ca7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1241 microversion: 2.1 time: 0.238363 Jun 30 13:06:03.398126 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 23/50] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:03 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1241 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:03.687287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-83b6dfd9-79ef-4f92-9799-440e7a1eb3e2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:03.691980 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-83b6dfd9-79ef-4f92-9799-440e7a1eb3e2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:03.715778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-83b6dfd9-79ef-4f92-9799-440e7a1eb3e2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:03.718122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-83b6dfd9-79ef-4f92-9799-440e7a1eb3e2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:03.719484 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-83b6dfd9-79ef-4f92-9799-440e7a1eb3e2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:03.720369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-83b6dfd9-79ef-4f92-9799-440e7a1eb3e2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:03.845802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-576d96ae-b28f-4276-9ec8-57962960bd14 tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Calling method '.version_select at 0x7f4ba4d2aca0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:04.005912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-576d96ae-b28f-4276-9ec8-57962960bd14 tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9" status: 200 len: 354 microversion: 2.1 time: 0.168952 Jun 30 13:06:04.013473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 24/51] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:06:03 2022] GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:04.019807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7871087d-3679-4fbc-b466-ac5574231bbb tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Calling method '.version_select at 0x7f4ba44e7550>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:04.203846 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7871087d-3679-4fbc-b466-ac5574231bbb tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9" status: 200 len: 354 microversion: 2.1 time: 0.188870 Jun 30 13:06:04.204798 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 25/52] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:06:04 2022] GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:04.225204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-87581100-e166-4376-9ad3-7f0672613bba tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Calling method '.version_select at 0x7f4ba44e7f70>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:04.447666 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-87581100-e166-4376-9ad3-7f0672613bba tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9" status: 202 len: 0 microversion: 2.1 time: 0.226279 Jun 30 13:06:04.448251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 26/53] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:06:04 2022] DELETE /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:06:04.453847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fb510039-f7ec-4140-a682-f150c08e2612 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:04.454489 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fb510039-f7ec-4140-a682-f150c08e2612 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:04.509324 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-83b6dfd9-79ef-4f92-9799-440e7a1eb3e2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:04.597405 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-83b6dfd9-79ef-4f92-9799-440e7a1eb3e2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1267 microversion: 2.1 time: 0.920650 Jun 30 13:06:04.601047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 28/54] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:03 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1267 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:04.632930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b424eba7-48ef-4fe0-8c17-ea79a0e5c0b7 tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Calling method '.version_select at 0x7f4ba44549d0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:04.730298 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b424eba7-48ef-4fe0-8c17-ea79a0e5c0b7 tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9" status: 200 len: 353 microversion: 2.1 time: 0.126999 Jun 30 13:06:04.731217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 29/55] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:06:04 2022] GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:04.739026 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1815555105", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bd7028d-1af5-4df0-a72b-3e547cce0e83"}], "security_groups": [{"name": "tempest-securitygroup--697988586"}], "key_name": "tempest-keypair-531342311", "user_data": "}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:04.936278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fb510039-f7ec-4140-a682-f150c08e2612 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:04.949040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fb510039-f7ec-4140-a682-f150c08e2612 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1241 microversion: 2.1 time: 0.498344 Jun 30 13:06:04.951357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 27/56] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:04 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1241 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:05.236876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] validate_networks() for [('3bd7028d-1af5-4df0-a72b-3e547cce0e83', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:06:05.619840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a483ba1d-ff60-4ac1-9bd4-ff05fb291b3c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:05.621023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a483ba1d-ff60-4ac1-9bd4-ff05fb291b3c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:05.634374 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a483ba1d-ff60-4ac1-9bd4-ff05fb291b3c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:05.634870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a483ba1d-ff60-4ac1-9bd4-ff05fb291b3c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:05.635634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a483ba1d-ff60-4ac1-9bd4-ff05fb291b3c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:05.636063 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a483ba1d-ff60-4ac1-9bd4-ff05fb291b3c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:06.200660 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a483ba1d-ff60-4ac1-9bd4-ff05fb291b3c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:06.228539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a483ba1d-ff60-4ac1-9bd4-ff05fb291b3c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1273 microversion: 2.1 time: 0.603117 Jun 30 13:06:06.229311 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 28/57] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:05 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1273 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:06.246837 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ae1b402d-5edf-48e9-971a-2aa9707b987b tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Calling method '.version_select at 0x7f4ba4d57430>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:06.309966 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-ae1b402d-5edf-48e9-971a-2aa9707b987b tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] HTTP exception thrown: Volume 3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 could not be found. Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ae1b402d-5edf-48e9-971a-2aa9707b987b tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Request method failure captured: Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 HTTP/1.1 Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-4LFqaS_606pOFJsRd30K1pHQS_es9z_V8HXgN6BJcicbLBVc1e45i7QWMI0-mG3h3AWJT0UMma3-GX3UE0CP6aBbkSDYwZ-76JlCJYwo1K4cCRz7cjjj1Tdlb8d6btLWXHRpjQoFvNOzbKG5slciTPg1gxegW5cPG3ShkTfErY64 Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: d839e9f8f73f4f0283f59c1fe1fb931b Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesGetTestJSON-1222353519 Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:06:06.312914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d839e9f8f73f4f0283f59c1fe1fb931b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d839e9f8f73f4f0283f59c1fe1fb931b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d839e9f8f73f4f0283f59c1fe1fb931b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d839e9f8f73f4f0283f59c1fe1fb931b"}]}] Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesGetTestJSON-1222353519 Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: d839e9f8f73f4f0283f59c1fe1fb931b Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesGetTestJSON-1222353519 Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesGetTestJSON-1222353519-project Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: ea28f54fe3c040de8e8b5cd823ae6c14 Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesGetTestJSON-1222353519-project Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Volume 3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 could not be found. Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9'} Jun 30 13:06:06.314334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 could not be found. (HTTP 404) (Request-ID: req-d1f989eb-b589-40ba-96ae-a86c3b8d8abb) Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:06:06.315157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 13:06:06.316078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 could not be found. Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 13:06:06.317050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 could not be found. Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 could not be found. Jun 30 13:06:06.318057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:06:06.319707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ae1b402d-5edf-48e9-971a-2aa9707b987b tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] Returning 404 to user: Volume 3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:06:06.320773 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ae1b402d-5edf-48e9-971a-2aa9707b987b tempest-VolumesGetTestJSON-1222353519 tempest-VolumesGetTestJSON-1222353519-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9" status: 404 len: 109 microversion: 2.1 time: 0.085796 Jun 30 13:06:06.321522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 29/58] 10.222.0.49 () {58 vars in 1244 bytes} [Thu Jun 30 13:06:06 2022] GET /compute/v2.1/os-volumes/3ed9c8ff-fe7d-4181-9219-1fb5bb8a3fa9 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:06:06.330847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e36ce812-3ff5-47c0-accc-7b53609c8300 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:06.332463 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e36ce812-3ff5-47c0-accc-7b53609c8300 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:06.354819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e36ce812-3ff5-47c0-accc-7b53609c8300 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:06.355566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e36ce812-3ff5-47c0-accc-7b53609c8300 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:06.356472 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e36ce812-3ff5-47c0-accc-7b53609c8300 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:06.358865 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e36ce812-3ff5-47c0-accc-7b53609c8300 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:06.555727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:06:06.556874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:06:06.557518 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:06:06.558071 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:06:06.558926 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:06:06.596790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:06.597931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:06.603248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:06.603868 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:06.679917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Getting quotas for project cee8ced67bdf4b5ca8aa12a8940b9bea. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:06:06.696723 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Getting quotas for user e5e99d5484594d13b113f27e77b37efd and project cee8ced67bdf4b5ca8aa12a8940b9bea. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:06:06.729275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e36ce812-3ff5-47c0-accc-7b53609c8300 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:06.735638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:06:06.738388 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:06:06.755811 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e36ce812-3ff5-47c0-accc-7b53609c8300 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1293 microversion: 2.1 time: 0.430141 Jun 30 13:06:06.761408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:06 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1293 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:06.789225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-890792729", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98947936-447b-42a6-83b5-89edd13aec37"}], "security_groups": [{"name": "tempest-securitygroup--216402034"}], "key_name": "tempest-keypair-2093773867", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:06.847551 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-19877465-b9e8-4128-bf02-a9dc37bde4df tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.114169 Jun 30 13:06:06.850021 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 30/60] 10.222.0.49 () {62 vars in 1187 bytes} [Thu Jun 30 13:06:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 13:06:06.861620 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4e779c77-2c41-459e-b0ce-afe76341a850 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:06.865395 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4e779c77-2c41-459e-b0ce-afe76341a850 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:07.249719 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4e779c77-2c41-459e-b0ce-afe76341a850 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:07.286607 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4e779c77-2c41-459e-b0ce-afe76341a850 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:07.290864 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4e779c77-2c41-459e-b0ce-afe76341a850 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:07.294441 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4e779c77-2c41-459e-b0ce-afe76341a850 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1281 microversion: 2.20 time: 0.438412 Jun 30 13:06:07.295039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:06 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1281 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:06:07.305647 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-06d339c1-a890-44aa-bda2-eede4e881e55 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:07.327074 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-06d339c1-a890-44aa-bda2-eede4e881e55 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:07.352314 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06d339c1-a890-44aa-bda2-eede4e881e55 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:07.352958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06d339c1-a890-44aa-bda2-eede4e881e55 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:07.353993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06d339c1-a890-44aa-bda2-eede4e881e55 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:07.354667 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06d339c1-a890-44aa-bda2-eede4e881e55 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:07.388375 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] validate_networks() for [('98947936-447b-42a6-83b5-89edd13aec37', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:06:07.584812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-06d339c1-a890-44aa-bda2-eede4e881e55 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:07.600227 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-06d339c1-a890-44aa-bda2-eede4e881e55 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1273 microversion: 2.1 time: 0.298430 Jun 30 13:06:07.602859 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 32/62] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:07 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:07.774544 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b9d0b492-cf04-45d6-a74a-11ab80695a5e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:07.775174 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b9d0b492-cf04-45d6-a74a-11ab80695a5e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:07.784198 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b9d0b492-cf04-45d6-a74a-11ab80695a5e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:07.784651 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b9d0b492-cf04-45d6-a74a-11ab80695a5e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:07.785561 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b9d0b492-cf04-45d6-a74a-11ab80695a5e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:07.785982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b9d0b492-cf04-45d6-a74a-11ab80695a5e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:08.024218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b9d0b492-cf04-45d6-a74a-11ab80695a5e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:08.033712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b9d0b492-cf04-45d6-a74a-11ab80695a5e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1299 microversion: 2.1 time: 0.263219 Jun 30 13:06:08.037291 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 33/63] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:07 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1299 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:08.313330 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:08.314173 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:08.322765 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:08.325939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:08.328973 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:08.330472 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:08.694976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:08.753450 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:08.755112 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:08.756221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-92d19765-e858-417e-8d02-68e4879e340e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1277 microversion: 2.20 time: 0.446996 Jun 30 13:06:08.756766 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 34/64] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:08 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1277 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:08.783879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0fab601c-292a-4b7a-8fd7-0cf995da8c7d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:08.784966 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0fab601c-292a-4b7a-8fd7-0cf995da8c7d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:08.811254 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0fab601c-292a-4b7a-8fd7-0cf995da8c7d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:08.812432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0fab601c-292a-4b7a-8fd7-0cf995da8c7d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:08.814791 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0fab601c-292a-4b7a-8fd7-0cf995da8c7d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:08.815409 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0fab601c-292a-4b7a-8fd7-0cf995da8c7d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:08.997526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0fab601c-292a-4b7a-8fd7-0cf995da8c7d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:09.038841 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0fab601c-292a-4b7a-8fd7-0cf995da8c7d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1273 microversion: 2.1 time: 0.267430 Jun 30 13:06:09.049805 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 35/65] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:08 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:09.059592 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-95fed5cb-c6fa-430d-9653-53bf94fbb4d7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:09.060541 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-95fed5cb-c6fa-430d-9653-53bf94fbb4d7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:09.078391 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-95fed5cb-c6fa-430d-9653-53bf94fbb4d7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:09.079220 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-95fed5cb-c6fa-430d-9653-53bf94fbb4d7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:09.080722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-95fed5cb-c6fa-430d-9653-53bf94fbb4d7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:09.085152 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-95fed5cb-c6fa-430d-9653-53bf94fbb4d7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:09.344190 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-95fed5cb-c6fa-430d-9653-53bf94fbb4d7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:09.366213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-95fed5cb-c6fa-430d-9653-53bf94fbb4d7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1299 microversion: 2.1 time: 0.305689 Jun 30 13:06:09.369385 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 36/66] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:09 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1299 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:09.783821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:09.787422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:09.823256 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:09.829528 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:09.830899 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:09.838126 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:09.979213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:10.139941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:10.156364 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:10.158056 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:10.167131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4f39381d-d35e-4876-8346-39ac0404ab1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1339 microversion: 2.20 time: 0.391315 Jun 30 13:06:10.191757 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 37/67] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:09 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1339 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:10.205300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-99a1e858-2a60-4c71-a38a-57a1a0077a80 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:10.210278 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-99a1e858-2a60-4c71-a38a-57a1a0077a80 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:10.220047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-99a1e858-2a60-4c71-a38a-57a1a0077a80 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:10.227954 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-99a1e858-2a60-4c71-a38a-57a1a0077a80 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:10.241566 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-99a1e858-2a60-4c71-a38a-57a1a0077a80 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:10.242387 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-99a1e858-2a60-4c71-a38a-57a1a0077a80 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:11.292889 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-99a1e858-2a60-4c71-a38a-57a1a0077a80 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:11.309559 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-99a1e858-2a60-4c71-a38a-57a1a0077a80 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 1.111330 Jun 30 13:06:11.313717 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 38/68] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:10 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:11.340150 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1a66dd89-78dd-4fc8-a8c6-677369e03b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:11.343822 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1a66dd89-78dd-4fc8-a8c6-677369e03b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:11.371564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a66dd89-78dd-4fc8-a8c6-677369e03b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:11.376195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a66dd89-78dd-4fc8-a8c6-677369e03b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:11.380428 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a66dd89-78dd-4fc8-a8c6-677369e03b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:11.381248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a66dd89-78dd-4fc8-a8c6-677369e03b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:11.450395 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:06:11.451568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:06:11.452371 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:06:11.453105 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:06:11.453680 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:06:11.474501 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:11.476375 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:11.479478 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:11.494594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:11.548740 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Getting quotas for project 2671e576de2c44e6b1f5df7c53aae76a. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:06:11.561715 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Getting quotas for user e0df4b789a804a00a267bcc5cf778324 and project 2671e576de2c44e6b1f5df7c53aae76a. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:06:11.625152 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:06:11.627892 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:06:11.784223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-15da502a-fdd6-4d41-b11e-db9a45a0c589 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.014491 Jun 30 13:06:11.789940 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 31/69] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:06:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 5021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:06:11.798186 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:11.800026 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:11.816577 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:11.817427 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:11.821146 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:11.823547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:11.932959 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1a66dd89-78dd-4fc8-a8c6-677369e03b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:11.950083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1a66dd89-78dd-4fc8-a8c6-677369e03b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1299 microversion: 2.1 time: 0.631199 Jun 30 13:06:11.963581 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 39/70] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:11 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1299 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:11.982077 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b3af0d40-6394-4f0f-9dbc-18329ffe14ef tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:11.983224 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b3af0d40-6394-4f0f-9dbc-18329ffe14ef tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:12.038200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:12.068275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:12.074110 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:12.080285 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dd25b62a-eae0-46e5-8495-d6a0af2b8bc2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1339 microversion: 2.20 time: 0.289118 Jun 30 13:06:12.081377 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 32/71] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:11 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1339 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:12.337240 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-189bb90b-16ca-4690-8065-b6db6623a4cc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:12.338341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-189bb90b-16ca-4690-8065-b6db6623a4cc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:12.369426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-189bb90b-16ca-4690-8065-b6db6623a4cc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:12.369882 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-189bb90b-16ca-4690-8065-b6db6623a4cc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:12.391336 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-189bb90b-16ca-4690-8065-b6db6623a4cc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:12.392118 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-189bb90b-16ca-4690-8065-b6db6623a4cc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:12.514812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b3af0d40-6394-4f0f-9dbc-18329ffe14ef tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:12.528663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b3af0d40-6394-4f0f-9dbc-18329ffe14ef tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1237 microversion: 2.1 time: 0.560256 Jun 30 13:06:12.532871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 40/72] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:11 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1237 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:12.988947 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3626f5ee-cadf-4aaa-a5a8-1b7cfef17899 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:12.990178 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3626f5ee-cadf-4aaa-a5a8-1b7cfef17899 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:12.993911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:13.010902 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3626f5ee-cadf-4aaa-a5a8-1b7cfef17899 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:13.012521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3626f5ee-cadf-4aaa-a5a8-1b7cfef17899 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:13.014161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3626f5ee-cadf-4aaa-a5a8-1b7cfef17899 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:13.019092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3626f5ee-cadf-4aaa-a5a8-1b7cfef17899 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:13.664965 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3626f5ee-cadf-4aaa-a5a8-1b7cfef17899 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:13.685572 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3626f5ee-cadf-4aaa-a5a8-1b7cfef17899 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.706255 Jun 30 13:06:13.696265 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 41/73] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:12 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:13.705646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:13.726845 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:13.761937 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:13.785722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:13.788032 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:13.790049 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:14.212613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:14.247541 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:14.267326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:14.268496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-faa15b47-ddcb-441f-a3d9-5466bff11f5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.569880 Jun 30 13:06:14.269626 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 42/74] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:13 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:14.284582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c9c501ce-69c7-4f86-ab16-f551b7278cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:14.285497 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c9c501ce-69c7-4f86-ab16-f551b7278cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:14.299134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9c501ce-69c7-4f86-ab16-f551b7278cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:14.299639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9c501ce-69c7-4f86-ab16-f551b7278cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:14.306361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9c501ce-69c7-4f86-ab16-f551b7278cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:14.307184 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9c501ce-69c7-4f86-ab16-f551b7278cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:14.501980 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c9c501ce-69c7-4f86-ab16-f551b7278cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:14.512471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c9c501ce-69c7-4f86-ab16-f551b7278cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1289 microversion: 2.1 time: 0.239594 Jun 30 13:06:14.513495 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 43/75] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:14 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1289 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:14.548797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-189bb90b-16ca-4690-8065-b6db6623a4cc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:14.570997 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-189bb90b-16ca-4690-8065-b6db6623a4cc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 2.239729 Jun 30 13:06:14.579491 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 33/76] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:12 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:14.713960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ca2dc4e1-8ff8-4a4a-aaf2-817154f5154d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:14.715849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ca2dc4e1-8ff8-4a4a-aaf2-817154f5154d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:14.727414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ca2dc4e1-8ff8-4a4a-aaf2-817154f5154d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:14.738826 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ca2dc4e1-8ff8-4a4a-aaf2-817154f5154d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:14.740086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ca2dc4e1-8ff8-4a4a-aaf2-817154f5154d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:14.742640 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ca2dc4e1-8ff8-4a4a-aaf2-817154f5154d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:15.287866 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:15.288800 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:15.297150 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:15.306735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:15.315651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:15.315651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:16.541555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ca2dc4e1-8ff8-4a4a-aaf2-817154f5154d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:16.544806 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:16.555526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ca2dc4e1-8ff8-4a4a-aaf2-817154f5154d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 1.846500 Jun 30 13:06:16.555744 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:16.568829 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:16.572680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 44/77] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:14 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:16.572901 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6daa282b-d36e-4abb-8352-b2e72b37f77a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 1.289849 Jun 30 13:06:16.573518 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 34/78] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:15 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:06:16.593166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2a9ece8a-dcca-4add-a4a2-a1c51d65cc02 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:16.594295 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2a9ece8a-dcca-4add-a4a2-a1c51d65cc02 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:16.599725 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8753985c-18a4-49c4-9614-399fba6022c8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:16.612988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a9ece8a-dcca-4add-a4a2-a1c51d65cc02 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:16.617177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a9ece8a-dcca-4add-a4a2-a1c51d65cc02 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:16.620837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a9ece8a-dcca-4add-a4a2-a1c51d65cc02 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:16.621647 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a9ece8a-dcca-4add-a4a2-a1c51d65cc02 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:16.625855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8753985c-18a4-49c4-9614-399fba6022c8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:16.627942 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=4 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:16.638838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8753985c-18a4-49c4-9614-399fba6022c8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:16.641682 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8753985c-18a4-49c4-9614-399fba6022c8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:16.642741 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8753985c-18a4-49c4-9614-399fba6022c8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:16.653708 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8753985c-18a4-49c4-9614-399fba6022c8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:16.776142 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2a9ece8a-dcca-4add-a4a2-a1c51d65cc02 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:16.793492 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2a9ece8a-dcca-4add-a4a2-a1c51d65cc02 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1295 microversion: 2.1 time: 0.219004 Jun 30 13:06:16.810568 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 45/79] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:16 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1295 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:17.256193 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8753985c-18a4-49c4-9614-399fba6022c8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:17.273870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8753985c-18a4-49c4-9614-399fba6022c8 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.674816 Jun 30 13:06:17.274679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 35/80] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:16 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:17.585728 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4e15ded4-b4ad-40bf-8735-56391fd45a3d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:17.592782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4e15ded4-b4ad-40bf-8735-56391fd45a3d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:17.592910 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:17.593531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:17.621617 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4e15ded4-b4ad-40bf-8735-56391fd45a3d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:17.629081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4e15ded4-b4ad-40bf-8735-56391fd45a3d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:17.639467 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4e15ded4-b4ad-40bf-8735-56391fd45a3d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:17.647272 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4e15ded4-b4ad-40bf-8735-56391fd45a3d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:17.649688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:17.656561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:17.663321 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:17.669876 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:18.539724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:18.549453 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:18.558906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:18.560417 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4fc80b8e-dce3-44a0-b08f-d54510366cc1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.972286 Jun 30 13:06:18.561225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 36/81] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:17 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:18.569072 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7df7040d-8f71-4e6d-950c-4a4692371add tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:18.573870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7df7040d-8f71-4e6d-950c-4a4692371add tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:18.582985 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7df7040d-8f71-4e6d-950c-4a4692371add tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:18.585698 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7df7040d-8f71-4e6d-950c-4a4692371add tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:18.591223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7df7040d-8f71-4e6d-950c-4a4692371add tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:18.591992 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7df7040d-8f71-4e6d-950c-4a4692371add tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:18.880953 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7df7040d-8f71-4e6d-950c-4a4692371add tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:18.892283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7df7040d-8f71-4e6d-950c-4a4692371add tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.329778 Jun 30 13:06:18.895060 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 37/82] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:18 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:18.902050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-42eef276-1db1-4ea9-870f-96edc9b58ebc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:18.905385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-42eef276-1db1-4ea9-870f-96edc9b58ebc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:18.914473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42eef276-1db1-4ea9-870f-96edc9b58ebc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:18.915286 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42eef276-1db1-4ea9-870f-96edc9b58ebc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:18.919325 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42eef276-1db1-4ea9-870f-96edc9b58ebc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:18.920089 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42eef276-1db1-4ea9-870f-96edc9b58ebc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.062878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4e15ded4-b4ad-40bf-8735-56391fd45a3d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:19.077487 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4e15ded4-b4ad-40bf-8735-56391fd45a3d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 1.500575 Jun 30 13:06:19.080705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 46/83] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:17 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:19.180941 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-42eef276-1db1-4ea9-870f-96edc9b58ebc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:19.189022 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-42eef276-1db1-4ea9-870f-96edc9b58ebc tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.292753 Jun 30 13:06:19.189932 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 38/84] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:18 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:19.250983 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-3463a983-c52f-4af1-905f-55f364c73f47 req-d3d638d7-88ed-432b-96a5-33401a20e100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a", "tag": "5e348e74-5afb-4473-a462-d6f5bfc34ce3"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:19.274043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3463a983-c52f-4af1-905f-55f364c73f47 req-d3d638d7-88ed-432b-96a5-33401a20e100 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.274526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3463a983-c52f-4af1-905f-55f364c73f47 req-d3d638d7-88ed-432b-96a5-33401a20e100 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.290252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-8acc1900-37a4-4f20-8d4e-d3ec5ab85859 req-7e73264d-03f2-4439-af7b-7cf26bae5989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2c8af5-6d65-4177-9434-65a1d15813c9", "tag": "c11821df-b3b9-4d4d-9e5c-85ddf105efeb"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:19.296149 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-3463a983-c52f-4af1-905f-55f364c73f47 req-d3d638d7-88ed-432b-96a5-33401a20e100 service nova] Creating event network-changed:5e348e74-5afb-4473-a462-d6f5bfc34ce3 for instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a on hv-cinder-81268 Jun 30 13:06:19.296758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3463a983-c52f-4af1-905f-55f364c73f47 req-d3d638d7-88ed-432b-96a5-33401a20e100 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117826) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 13:06:19.298210 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6ce972c7-7323-4f75-95bb-421918fca27c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.298769 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6ce972c7-7323-4f75-95bb-421918fca27c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.299619 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6ce972c7-7323-4f75-95bb-421918fca27c None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.300116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6ce972c7-7323-4f75-95bb-421918fca27c None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.302552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8acc1900-37a4-4f20-8d4e-d3ec5ab85859 req-7e73264d-03f2-4439-af7b-7cf26bae5989 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.303150 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8acc1900-37a4-4f20-8d4e-d3ec5ab85859 req-7e73264d-03f2-4439-af7b-7cf26bae5989 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.309749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.compute.rpcapi [None req-6ce972c7-7323-4f75-95bb-421918fca27c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 13:06:19.310759 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6ce972c7-7323-4f75-95bb-421918fca27c None None] Releasing lock "compute-rpcapi-router" {{(pid=117826) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 13:06:19.323035 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-8acc1900-37a4-4f20-8d4e-d3ec5ab85859 req-7e73264d-03f2-4439-af7b-7cf26bae5989 service nova] Creating event network-changed:c11821df-b3b9-4d4d-9e5c-85ddf105efeb for instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 on hv-cinder-81268 Jun 30 13:06:19.323916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8acc1900-37a4-4f20-8d4e-d3ec5ab85859 req-7e73264d-03f2-4439-af7b-7cf26bae5989 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117825) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 13:06:19.325159 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f07692-c42e-4536-82ab-8174d454605d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.325614 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f07692-c42e-4536-82ab-8174d454605d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.326436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f07692-c42e-4536-82ab-8174d454605d None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.327026 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f07692-c42e-4536-82ab-8174d454605d None None] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.331236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6ce972c7-7323-4f75-95bb-421918fca27c None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247132 Jun 30 13:06:19.335760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 47/85] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:19.337425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.compute.rpcapi [None req-99f07692-c42e-4536-82ab-8174d454605d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 13:06:19.338503 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99f07692-c42e-4536-82ab-8174d454605d None None] Releasing lock "compute-rpcapi-router" {{(pid=117825) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 13:06:19.353909 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-99f07692-c42e-4536-82ab-8174d454605d None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156384 Jun 30 13:06:19.354616 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 39/86] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:06:19.584742 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:19.585424 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:19.592169 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.592607 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.593363 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.593787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.598001 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:19.733620 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:19.742893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:19.744471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:19.745758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8463da47-447b-41b9-8f03-03a236e476fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.165705 Jun 30 13:06:19.746328 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 48/87] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:19 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:19.912534 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6b110d9e-c9ab-44b8-92f6-10556fcf3598 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:19.913098 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6b110d9e-c9ab-44b8-92f6-10556fcf3598 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:19.919750 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b110d9e-c9ab-44b8-92f6-10556fcf3598 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.920189 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b110d9e-c9ab-44b8-92f6-10556fcf3598 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:19.920925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b110d9e-c9ab-44b8-92f6-10556fcf3598 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:19.921341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6b110d9e-c9ab-44b8-92f6-10556fcf3598 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:20.057717 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6b110d9e-c9ab-44b8-92f6-10556fcf3598 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:20.065917 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6b110d9e-c9ab-44b8-92f6-10556fcf3598 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.157829 Jun 30 13:06:20.066903 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 40/88] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:19 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:20.097245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a565566c-d56e-4762-bddc-c5c89c1e71f2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:20.098067 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a565566c-d56e-4762-bddc-c5c89c1e71f2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:20.104690 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a565566c-d56e-4762-bddc-c5c89c1e71f2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:20.105127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a565566c-d56e-4762-bddc-c5c89c1e71f2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:20.105886 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a565566c-d56e-4762-bddc-c5c89c1e71f2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:20.106312 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a565566c-d56e-4762-bddc-c5c89c1e71f2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:20.205926 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-895fa7f9-8dd9-469c-b48d-53a3ad905b5d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:20.206584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-895fa7f9-8dd9-469c-b48d-53a3ad905b5d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:20.212855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-895fa7f9-8dd9-469c-b48d-53a3ad905b5d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:20.213320 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-895fa7f9-8dd9-469c-b48d-53a3ad905b5d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:20.214071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-895fa7f9-8dd9-469c-b48d-53a3ad905b5d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:20.214870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-895fa7f9-8dd9-469c-b48d-53a3ad905b5d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:20.241469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a565566c-d56e-4762-bddc-c5c89c1e71f2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:20.249182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a565566c-d56e-4762-bddc-c5c89c1e71f2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.155890 Jun 30 13:06:20.249749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 49/89] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:20 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:20.344450 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-895fa7f9-8dd9-469c-b48d-53a3ad905b5d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:20.356525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-895fa7f9-8dd9-469c-b48d-53a3ad905b5d tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.154095 Jun 30 13:06:20.357290 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 41/90] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:20 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:20.764032 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:20.764606 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:20.770882 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:20.771251 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:20.771983 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:20.772394 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:20.908038 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:20.916778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:20.918261 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:20.919384 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-04f3d49f-8dd2-44dc-9e4f-e486eb1ccf47 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.159396 Jun 30 13:06:20.919928 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 50/91] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:20 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:21.082995 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0254ee1a-6c00-4cf5-ac13-55ae1504ed7a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:21.083597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0254ee1a-6c00-4cf5-ac13-55ae1504ed7a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:21.089809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0254ee1a-6c00-4cf5-ac13-55ae1504ed7a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.090251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0254ee1a-6c00-4cf5-ac13-55ae1504ed7a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:21.091035 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0254ee1a-6c00-4cf5-ac13-55ae1504ed7a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.091581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0254ee1a-6c00-4cf5-ac13-55ae1504ed7a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:21.240828 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0254ee1a-6c00-4cf5-ac13-55ae1504ed7a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:21.266239 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2e13846b-a0aa-49d2-8614-493b7ecd1879 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:21.269626 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2e13846b-a0aa-49d2-8614-493b7ecd1879 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:21.284129 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0254ee1a-6c00-4cf5-ac13-55ae1504ed7a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.204825 Jun 30 13:06:21.285374 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2e13846b-a0aa-49d2-8614-493b7ecd1879 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.285888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2e13846b-a0aa-49d2-8614-493b7ecd1879 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:21.286827 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2e13846b-a0aa-49d2-8614-493b7ecd1879 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.287264 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2e13846b-a0aa-49d2-8614-493b7ecd1879 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:21.294239 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 42/92] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:21 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:21.347519 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-aa82150e-dbd6-469b-8c6e-0c2526da4bab req-cad918ad-0718-4347-aa6a-64eb69412342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10b1702-58cf-40cd-b199-96482a3f4721", "tag": "5b9dd1a2-b979-4c96-b0dc-ed91d8fe6a47"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:21.356424 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-aa82150e-dbd6-469b-8c6e-0c2526da4bab req-cad918ad-0718-4347-aa6a-64eb69412342 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.357067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-aa82150e-dbd6-469b-8c6e-0c2526da4bab req-cad918ad-0718-4347-aa6a-64eb69412342 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:21.369400 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-aa82150e-dbd6-469b-8c6e-0c2526da4bab req-cad918ad-0718-4347-aa6a-64eb69412342 service nova] Creating event network-changed:5b9dd1a2-b979-4c96-b0dc-ed91d8fe6a47 for instance c10b1702-58cf-40cd-b199-96482a3f4721 on hv-cinder-81268 Jun 30 13:06:21.374818 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-aa82150e-dbd6-469b-8c6e-0c2526da4bab req-cad918ad-0718-4347-aa6a-64eb69412342 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031564 Jun 30 13:06:21.375209 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 43/93] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:06:21.381847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6fec9c34-f182-4065-a713-f9505df12387 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:21.382559 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6fec9c34-f182-4065-a713-f9505df12387 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:21.389009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fec9c34-f182-4065-a713-f9505df12387 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.389444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fec9c34-f182-4065-a713-f9505df12387 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:21.390186 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fec9c34-f182-4065-a713-f9505df12387 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.390662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6fec9c34-f182-4065-a713-f9505df12387 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:21.428980 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2e13846b-a0aa-49d2-8614-493b7ecd1879 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:21.436852 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2e13846b-a0aa-49d2-8614-493b7ecd1879 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.174739 Jun 30 13:06:21.437432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 51/94] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:21 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:21.523418 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6fec9c34-f182-4065-a713-f9505df12387 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:21.534462 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6fec9c34-f182-4065-a713-f9505df12387 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.154874 Jun 30 13:06:21.535673 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 44/95] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:21 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:21.941877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:21.942997 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:21.953140 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.953860 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:21.955144 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:21.955836 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:22.086582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:22.095014 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:22.096505 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:22.097735 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-55184759-92e3-4d2a-9f3c-fb0a6cb1bb9e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.162543 Jun 30 13:06:22.098346 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 52/96] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:21 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:22.301573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0cdf4a06-587f-4ab4-a7d5-e4f5d99db93e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:22.302987 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0cdf4a06-587f-4ab4-a7d5-e4f5d99db93e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:22.312372 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=20 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:22.313235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:22.323344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cdf4a06-587f-4ab4-a7d5-e4f5d99db93e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:22.324143 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cdf4a06-587f-4ab4-a7d5-e4f5d99db93e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:22.324958 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cdf4a06-587f-4ab4-a7d5-e4f5d99db93e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:22.325385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0cdf4a06-587f-4ab4-a7d5-e4f5d99db93e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:22.331311 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=89 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:22.454285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-aba326ea-6c53-434f-b931-d5b7c9629edf tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:22.455786 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-aba326ea-6c53-434f-b931-d5b7c9629edf tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:22.463488 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aba326ea-6c53-434f-b931-d5b7c9629edf tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:22.464165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aba326ea-6c53-434f-b931-d5b7c9629edf tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:22.465376 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0cdf4a06-587f-4ab4-a7d5-e4f5d99db93e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:22.465607 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aba326ea-6c53-434f-b931-d5b7c9629edf tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:22.466165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aba326ea-6c53-434f-b931-d5b7c9629edf tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:22.477774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0cdf4a06-587f-4ab4-a7d5-e4f5d99db93e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.180478 Jun 30 13:06:22.487266 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 45/97] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:22 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:22.526066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=28 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:22.553547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f86f57c3-1bdd-421e-95a8-ac66e5c915c2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:22.554429 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f86f57c3-1bdd-421e-95a8-ac66e5c915c2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:22.568517 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f86f57c3-1bdd-421e-95a8-ac66e5c915c2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:22.569098 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f86f57c3-1bdd-421e-95a8-ac66e5c915c2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:22.570024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f86f57c3-1bdd-421e-95a8-ac66e5c915c2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:22.570585 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f86f57c3-1bdd-421e-95a8-ac66e5c915c2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:22.641609 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-aba326ea-6c53-434f-b931-d5b7c9629edf tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:22.654945 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-aba326ea-6c53-434f-b931-d5b7c9629edf tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.205382 Jun 30 13:06:22.655901 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 53/98] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:22 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:22.761231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f86f57c3-1bdd-421e-95a8-ac66e5c915c2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:22.779097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f86f57c3-1bdd-421e-95a8-ac66e5c915c2 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.229608 Jun 30 13:06:22.789422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 46/99] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:22 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:23.117287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:23.117914 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:23.124422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:23.124868 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:23.125901 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:23.126344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:23.281375 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:23.293817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:23.296367 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:23.298908 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-20896fd5-1394-4347-afec-ae7372bbf34a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.186275 Jun 30 13:06:23.300057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 54/100] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:23 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:23.505702 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b679a102-0f87-4541-afd9-a79c3c9d7002 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:23.506603 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b679a102-0f87-4541-afd9-a79c3c9d7002 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:23.524609 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b679a102-0f87-4541-afd9-a79c3c9d7002 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:23.525726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b679a102-0f87-4541-afd9-a79c3c9d7002 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:23.526787 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b679a102-0f87-4541-afd9-a79c3c9d7002 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:23.527209 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b679a102-0f87-4541-afd9-a79c3c9d7002 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:23.678850 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e5cd0775-087c-4b02-b3c0-ce6ae4c3c8bb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:23.685478 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e5cd0775-087c-4b02-b3c0-ce6ae4c3c8bb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:23.688878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e5cd0775-087c-4b02-b3c0-ce6ae4c3c8bb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:23.689749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e5cd0775-087c-4b02-b3c0-ce6ae4c3c8bb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:23.691114 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e5cd0775-087c-4b02-b3c0-ce6ae4c3c8bb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:23.692055 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e5cd0775-087c-4b02-b3c0-ce6ae4c3c8bb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:23.706940 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b679a102-0f87-4541-afd9-a79c3c9d7002 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:23.723523 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b679a102-0f87-4541-afd9-a79c3c9d7002 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.225477 Jun 30 13:06:23.724575 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 47/101] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:23 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:23.803646 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0caae75-3a2d-4e3d-90a9-d64d93ef5a98 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:23.804512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0caae75-3a2d-4e3d-90a9-d64d93ef5a98 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:23.811319 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0caae75-3a2d-4e3d-90a9-d64d93ef5a98 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:23.812149 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0caae75-3a2d-4e3d-90a9-d64d93ef5a98 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:23.813101 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0caae75-3a2d-4e3d-90a9-d64d93ef5a98 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:23.813540 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0caae75-3a2d-4e3d-90a9-d64d93ef5a98 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:23.991549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e5cd0775-087c-4b02-b3c0-ce6ae4c3c8bb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:24.001443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e5cd0775-087c-4b02-b3c0-ce6ae4c3c8bb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.330403 Jun 30 13:06:24.002172 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 55/102] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:23 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:24.084826 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0caae75-3a2d-4e3d-90a9-d64d93ef5a98 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:24.094415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0caae75-3a2d-4e3d-90a9-d64d93ef5a98 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.300891 Jun 30 13:06:24.094994 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 48/103] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:23 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:24.317678 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:24.318203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:24.324442 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:24.324902 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:24.325646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:24.326065 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:24.526583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:24.537840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:24.539671 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:24.541170 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0f12f2b3-d343-4b48-b681-17663d31ed10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.227775 Jun 30 13:06:24.551392 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 56/104] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:24 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:06:24.740781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2827fa4-45cc-4177-9353-4f6bde9d4664 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:24.741465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2827fa4-45cc-4177-9353-4f6bde9d4664 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:24.749633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2827fa4-45cc-4177-9353-4f6bde9d4664 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:24.750043 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2827fa4-45cc-4177-9353-4f6bde9d4664 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:24.750829 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2827fa4-45cc-4177-9353-4f6bde9d4664 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:24.751247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2827fa4-45cc-4177-9353-4f6bde9d4664 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:24.928876 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2827fa4-45cc-4177-9353-4f6bde9d4664 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:24.941156 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2827fa4-45cc-4177-9353-4f6bde9d4664 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.204153 Jun 30 13:06:24.941861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 49/105] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:24 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:25.019587 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e50cf6a1-1c6a-4c33-8d80-10723927f4dd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:25.021514 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e50cf6a1-1c6a-4c33-8d80-10723927f4dd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:25.033389 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e50cf6a1-1c6a-4c33-8d80-10723927f4dd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:25.033843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e50cf6a1-1c6a-4c33-8d80-10723927f4dd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:25.034963 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e50cf6a1-1c6a-4c33-8d80-10723927f4dd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:25.041038 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e50cf6a1-1c6a-4c33-8d80-10723927f4dd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:25.112363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1a96bb8b-9aa9-4874-a99d-fec6f3ce035b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:25.113919 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1a96bb8b-9aa9-4874-a99d-fec6f3ce035b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:25.124580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a96bb8b-9aa9-4874-a99d-fec6f3ce035b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:25.124580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a96bb8b-9aa9-4874-a99d-fec6f3ce035b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:25.125466 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a96bb8b-9aa9-4874-a99d-fec6f3ce035b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:25.126311 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a96bb8b-9aa9-4874-a99d-fec6f3ce035b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:25.423610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1a96bb8b-9aa9-4874-a99d-fec6f3ce035b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:25.432805 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1a96bb8b-9aa9-4874-a99d-fec6f3ce035b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.324802 Jun 30 13:06:25.436086 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 50/106] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:25 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:25.560493 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:25.561467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:25.574444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:25.574921 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:25.575843 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:25.576436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:25.782432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e50cf6a1-1c6a-4c33-8d80-10723927f4dd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:25.792810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e50cf6a1-1c6a-4c33-8d80-10723927f4dd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.777830 Jun 30 13:06:25.794248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 57/107] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:25 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:25.964224 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bc95b1c1-6c50-41c3-a966-e60da8e3bf71 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:25.966399 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bc95b1c1-6c50-41c3-a966-e60da8e3bf71 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:25.975602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bc95b1c1-6c50-41c3-a966-e60da8e3bf71 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:25.976473 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bc95b1c1-6c50-41c3-a966-e60da8e3bf71 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:25.977817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bc95b1c1-6c50-41c3-a966-e60da8e3bf71 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:25.978538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bc95b1c1-6c50-41c3-a966-e60da8e3bf71 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:26.132697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:26.149391 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:26.153689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:26.155952 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e399fa3a-6be7-461e-a4eb-42ab343e048a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.598467 Jun 30 13:06:26.171328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 51/108] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:25 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:06:26.455187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c7286a17-77b1-4502-8104-7e7d2b782f11 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:26.456448 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c7286a17-77b1-4502-8104-7e7d2b782f11 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:26.468514 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7286a17-77b1-4502-8104-7e7d2b782f11 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:26.472481 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7286a17-77b1-4502-8104-7e7d2b782f11 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:26.475229 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7286a17-77b1-4502-8104-7e7d2b782f11 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:26.475700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c7286a17-77b1-4502-8104-7e7d2b782f11 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:26.483303 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bc95b1c1-6c50-41c3-a966-e60da8e3bf71 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:26.492411 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bc95b1c1-6c50-41c3-a966-e60da8e3bf71 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.537004 Jun 30 13:06:26.495939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 58/109] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:25 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:26.800012 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c7286a17-77b1-4502-8104-7e7d2b782f11 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:26.811941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2fd2d8cb-f429-4004-915a-914d79fb0b9e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:26.812996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2fd2d8cb-f429-4004-915a-914d79fb0b9e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:26.826638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2fd2d8cb-f429-4004-915a-914d79fb0b9e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:26.828441 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2fd2d8cb-f429-4004-915a-914d79fb0b9e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:26.829408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c7286a17-77b1-4502-8104-7e7d2b782f11 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.380260 Jun 30 13:06:26.829745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2fd2d8cb-f429-4004-915a-914d79fb0b9e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:26.830866 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2fd2d8cb-f429-4004-915a-914d79fb0b9e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:26.847477 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 52/110] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:26 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:27.105021 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-54f6fb2b-172c-4ef7-89c6-2d72b70bb696 req-e990a3ab-073d-4af5-8e08-a1edbca84bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfaf5f03-a265-481f-81c5-2f4432079c41", "tag": "3af06866-5ee3-41a6-97e5-30ef336cf968"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:27.114168 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-54f6fb2b-172c-4ef7-89c6-2d72b70bb696 req-e990a3ab-073d-4af5-8e08-a1edbca84bb6 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:27.116098 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-54f6fb2b-172c-4ef7-89c6-2d72b70bb696 req-e990a3ab-073d-4af5-8e08-a1edbca84bb6 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:27.129474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-54f6fb2b-172c-4ef7-89c6-2d72b70bb696 req-e990a3ab-073d-4af5-8e08-a1edbca84bb6 service nova] Creating event network-changed:3af06866-5ee3-41a6-97e5-30ef336cf968 for instance bfaf5f03-a265-481f-81c5-2f4432079c41 on hv-cinder-81268 Jun 30 13:06:27.141071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-54f6fb2b-172c-4ef7-89c6-2d72b70bb696 req-e990a3ab-073d-4af5-8e08-a1edbca84bb6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037011 Jun 30 13:06:27.141640 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2fd2d8cb-f429-4004-915a-914d79fb0b9e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:27.144229 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 53/111] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:27.152839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2fd2d8cb-f429-4004-915a-914d79fb0b9e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.345827 Jun 30 13:06:27.153420 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 59/112] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:26 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:27.177674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:27.179547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:27.185894 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:27.186353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:27.191767 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:27.192483 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:27.356238 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:27.365430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:27.367436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:27.368592 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0e79748b-fd6d-4103-b978-7e11efc6934d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.196432 Jun 30 13:06:27.369613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 54/113] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:27 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:27.512645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-43d9e30f-10fd-4c36-8393-963597bd9de4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:27.513337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-43d9e30f-10fd-4c36-8393-963597bd9de4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:27.530835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43d9e30f-10fd-4c36-8393-963597bd9de4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:27.531284 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43d9e30f-10fd-4c36-8393-963597bd9de4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:27.532066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43d9e30f-10fd-4c36-8393-963597bd9de4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:27.532492 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43d9e30f-10fd-4c36-8393-963597bd9de4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:27.789098 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-43d9e30f-10fd-4c36-8393-963597bd9de4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:27.799227 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-43d9e30f-10fd-4c36-8393-963597bd9de4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.290320 Jun 30 13:06:27.800490 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 60/114] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:27 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:27.847918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a59e23a6-5aa0-48d2-bb4b-9753e291d439 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:27.848879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a59e23a6-5aa0-48d2-bb4b-9753e291d439 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:27.856219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a59e23a6-5aa0-48d2-bb4b-9753e291d439 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:27.857359 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a59e23a6-5aa0-48d2-bb4b-9753e291d439 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:27.858522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a59e23a6-5aa0-48d2-bb4b-9753e291d439 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:27.859182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a59e23a6-5aa0-48d2-bb4b-9753e291d439 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:28.058211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a59e23a6-5aa0-48d2-bb4b-9753e291d439 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:28.066150 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a59e23a6-5aa0-48d2-bb4b-9753e291d439 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.222797 Jun 30 13:06:28.066760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 55/115] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:27 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:28.171604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bd05f81f-2691-4630-836a-7578408e5c01 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:28.172214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bd05f81f-2691-4630-836a-7578408e5c01 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:28.179109 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd05f81f-2691-4630-836a-7578408e5c01 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:28.179719 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd05f81f-2691-4630-836a-7578408e5c01 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:28.180762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd05f81f-2691-4630-836a-7578408e5c01 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:28.181195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd05f81f-2691-4630-836a-7578408e5c01 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:28.326810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd05f81f-2691-4630-836a-7578408e5c01 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:28.335329 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bd05f81f-2691-4630-836a-7578408e5c01 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.167474 Jun 30 13:06:28.336319 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 61/116] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:28 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:28.387493 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:28.389062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:28.397892 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:28.399115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:28.400178 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:28.400842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:28.576421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:28.586541 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:28.588266 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:28.589937 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8b71a935-973e-41fb-8d86-475b40582ed0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.206082 Jun 30 13:06:28.590749 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 56/117] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:28 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:06:28.817591 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1b82e959-3515-4c0d-81fa-a774921d603d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:28.818279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1b82e959-3515-4c0d-81fa-a774921d603d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:28.827745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1b82e959-3515-4c0d-81fa-a774921d603d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:28.830543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1b82e959-3515-4c0d-81fa-a774921d603d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:28.831918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1b82e959-3515-4c0d-81fa-a774921d603d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:28.832537 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1b82e959-3515-4c0d-81fa-a774921d603d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:29.083993 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc4cfe1e-b96d-4fb0-abe1-3481d9e25b0c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:29.085057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc4cfe1e-b96d-4fb0-abe1-3481d9e25b0c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:29.095557 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc4cfe1e-b96d-4fb0-abe1-3481d9e25b0c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:29.096513 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc4cfe1e-b96d-4fb0-abe1-3481d9e25b0c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:29.097908 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc4cfe1e-b96d-4fb0-abe1-3481d9e25b0c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:29.101335 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc4cfe1e-b96d-4fb0-abe1-3481d9e25b0c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:29.309017 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:29.334273 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:29.532568 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1b82e959-3515-4c0d-81fa-a774921d603d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:29.546796 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1b82e959-3515-4c0d-81fa-a774921d603d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.733281 Jun 30 13:06:29.559316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 62/118] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:28 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:29.571336 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f826e195-a8e9-4cd9-9e35-266b2056883b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:29.572508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f826e195-a8e9-4cd9-9e35-266b2056883b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:29.594183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f826e195-a8e9-4cd9-9e35-266b2056883b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:29.594685 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f826e195-a8e9-4cd9-9e35-266b2056883b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:29.595481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f826e195-a8e9-4cd9-9e35-266b2056883b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:29.595916 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f826e195-a8e9-4cd9-9e35-266b2056883b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:29.706578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc4cfe1e-b96d-4fb0-abe1-3481d9e25b0c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:29.724405 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc4cfe1e-b96d-4fb0-abe1-3481d9e25b0c tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.642074 Jun 30 13:06:29.727631 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 57/119] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:29 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:29.743000 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:29.745051 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:29.763620 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:29.767404 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:29.769841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:29.774284 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:30.112162 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f826e195-a8e9-4cd9-9e35-266b2056883b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:30.123978 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f826e195-a8e9-4cd9-9e35-266b2056883b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.562860 Jun 30 13:06:30.127962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 63/120] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:29 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:30.388210 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:30.405607 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:30.405607 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:30.429160 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2677a723-323e-4580-8129-220b3e18927e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.699133 Jun 30 13:06:30.431804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 58/121] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:29 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:30.564859 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-83e59f30-5945-43a1-af8b-4ba477f5e425 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:30.569740 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-83e59f30-5945-43a1-af8b-4ba477f5e425 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:30.580932 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-83e59f30-5945-43a1-af8b-4ba477f5e425 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:30.585070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-83e59f30-5945-43a1-af8b-4ba477f5e425 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:30.585805 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-83e59f30-5945-43a1-af8b-4ba477f5e425 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:30.586241 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-83e59f30-5945-43a1-af8b-4ba477f5e425 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:30.741790 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b89ac8a7-a70c-43a9-b2de-34e2e0a68bfa tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:30.742962 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b89ac8a7-a70c-43a9-b2de-34e2e0a68bfa tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:30.752950 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b89ac8a7-a70c-43a9-b2de-34e2e0a68bfa tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:30.753595 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b89ac8a7-a70c-43a9-b2de-34e2e0a68bfa tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:30.754549 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b89ac8a7-a70c-43a9-b2de-34e2e0a68bfa tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:30.755116 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b89ac8a7-a70c-43a9-b2de-34e2e0a68bfa tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:30.784086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-83e59f30-5945-43a1-af8b-4ba477f5e425 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:30.790268 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:30.793459 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-83e59f30-5945-43a1-af8b-4ba477f5e425 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.232423 Jun 30 13:06:30.803028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 64/122] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:30 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:30.945349 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b89ac8a7-a70c-43a9-b2de-34e2e0a68bfa tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:30.957239 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b89ac8a7-a70c-43a9-b2de-34e2e0a68bfa tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.219681 Jun 30 13:06:30.958850 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 59/123] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:30 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:31.145006 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d208d94e-7b1f-40cb-8a25-6db8043a62c3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:31.146205 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d208d94e-7b1f-40cb-8a25-6db8043a62c3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:31.153140 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d208d94e-7b1f-40cb-8a25-6db8043a62c3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:31.153577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d208d94e-7b1f-40cb-8a25-6db8043a62c3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:31.154460 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d208d94e-7b1f-40cb-8a25-6db8043a62c3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:31.154927 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d208d94e-7b1f-40cb-8a25-6db8043a62c3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:31.397166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d208d94e-7b1f-40cb-8a25-6db8043a62c3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:31.414756 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d208d94e-7b1f-40cb-8a25-6db8043a62c3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.272544 Jun 30 13:06:31.418628 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 65/124] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:31 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:31.450363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:31.452294 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:31.467869 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:31.468782 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:31.471092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:31.471718 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:31.811775 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-78984a6c-0074-4f55-a63a-968c53ca97ff tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:31.811775 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-78984a6c-0074-4f55-a63a-968c53ca97ff tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:31.825731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-78984a6c-0074-4f55-a63a-968c53ca97ff tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:31.826420 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-78984a6c-0074-4f55-a63a-968c53ca97ff tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:31.827517 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-78984a6c-0074-4f55-a63a-968c53ca97ff tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:31.828091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-78984a6c-0074-4f55-a63a-968c53ca97ff tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:31.836419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:31.845806 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:31.852567 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:31.853709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-891756c1-0450-487b-a8c4-7b661ca807cd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.408425 Jun 30 13:06:31.858338 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 60/125] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:31 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:31.974643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1b55eea-093e-4e4b-a86e-3752de676083 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:31.975304 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1b55eea-093e-4e4b-a86e-3752de676083 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:31.979519 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-78984a6c-0074-4f55-a63a-968c53ca97ff tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:31.983223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1b55eea-093e-4e4b-a86e-3752de676083 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:31.985007 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1b55eea-093e-4e4b-a86e-3752de676083 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:31.986980 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1b55eea-093e-4e4b-a86e-3752de676083 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:31.987745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1b55eea-093e-4e4b-a86e-3752de676083 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:31.989744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-78984a6c-0074-4f55-a63a-968c53ca97ff tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.182836 Jun 30 13:06:31.990864 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 66/126] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:31 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:32.136325 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b1b55eea-093e-4e4b-a86e-3752de676083 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:32.144170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1b55eea-093e-4e4b-a86e-3752de676083 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.173406 Jun 30 13:06:32.144738 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 61/127] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:31 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:32.419486 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-9f27b705-3ec6-4906-b436-71ebc99bd4a4 req-d4f94b3c-141c-41bd-9033-1e886989258d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a", "name": "network-vif-plugged", "status": "completed", "tag": "5e348e74-5afb-4473-a462-d6f5bfc34ce3"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:32.428313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-9f27b705-3ec6-4906-b436-71ebc99bd4a4 req-d4f94b3c-141c-41bd-9033-1e886989258d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:32.428835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-9f27b705-3ec6-4906-b436-71ebc99bd4a4 req-d4f94b3c-141c-41bd-9033-1e886989258d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:32.431436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dd63f0cf-86cb-478b-b642-f65c7f3e8685 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:32.432238 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dd63f0cf-86cb-478b-b642-f65c7f3e8685 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:32.441484 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd63f0cf-86cb-478b-b642-f65c7f3e8685 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:32.442341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd63f0cf-86cb-478b-b642-f65c7f3e8685 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:32.443494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd63f0cf-86cb-478b-b642-f65c7f3e8685 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:32.444107 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-9f27b705-3ec6-4906-b436-71ebc99bd4a4 req-d4f94b3c-141c-41bd-9033-1e886989258d service nova] Creating event network-vif-plugged:5e348e74-5afb-4473-a462-d6f5bfc34ce3 for instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a on hv-cinder-81268 Jun 30 13:06:32.444299 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dd63f0cf-86cb-478b-b642-f65c7f3e8685 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:32.450892 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-9f27b705-3ec6-4906-b436-71ebc99bd4a4 req-d4f94b3c-141c-41bd-9033-1e886989258d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350065 Jun 30 13:06:32.451996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 67/128] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:32.467893 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:32.671118 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dd63f0cf-86cb-478b-b642-f65c7f3e8685 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:32.686734 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dd63f0cf-86cb-478b-b642-f65c7f3e8685 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.259089 Jun 30 13:06:32.692458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 62/129] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:32 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:32.873422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:32.874077 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:32.884216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:32.884907 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:32.886006 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:32.886887 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:33.007269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-04fea6aa-e66b-42af-9e62-80d65e1a5c47 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:33.008256 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-04fea6aa-e66b-42af-9e62-80d65e1a5c47 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:33.015765 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04fea6aa-e66b-42af-9e62-80d65e1a5c47 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:33.016343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04fea6aa-e66b-42af-9e62-80d65e1a5c47 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:33.018172 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04fea6aa-e66b-42af-9e62-80d65e1a5c47 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:33.019055 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04fea6aa-e66b-42af-9e62-80d65e1a5c47 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:33.042812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:33.053252 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:33.055453 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:33.056973 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d4dea144-0bae-4b64-9992-32763887787a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.188121 Jun 30 13:06:33.070933 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 68/130] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:32 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:33.162629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-631dcca5-1c22-416d-bf4f-4ca65ecca16f tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:33.163226 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-631dcca5-1c22-416d-bf4f-4ca65ecca16f tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:33.171963 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-631dcca5-1c22-416d-bf4f-4ca65ecca16f tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:33.172421 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-631dcca5-1c22-416d-bf4f-4ca65ecca16f tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:33.173187 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-631dcca5-1c22-416d-bf4f-4ca65ecca16f tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:33.175386 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-631dcca5-1c22-416d-bf4f-4ca65ecca16f tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:33.178192 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-04fea6aa-e66b-42af-9e62-80d65e1a5c47 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:33.190083 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-04fea6aa-e66b-42af-9e62-80d65e1a5c47 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.187176 Jun 30 13:06:33.201577 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 63/131] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:33 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:33.332616 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-631dcca5-1c22-416d-bf4f-4ca65ecca16f tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:33.341061 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-631dcca5-1c22-416d-bf4f-4ca65ecca16f tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.183691 Jun 30 13:06:33.341955 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 69/132] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:33 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:33.710564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea3ecca9-ff88-4dd4-9d62-8408b2446428 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:33.711166 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea3ecca9-ff88-4dd4-9d62-8408b2446428 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:33.717612 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea3ecca9-ff88-4dd4-9d62-8408b2446428 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:33.718053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea3ecca9-ff88-4dd4-9d62-8408b2446428 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:33.718840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea3ecca9-ff88-4dd4-9d62-8408b2446428 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:33.719501 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea3ecca9-ff88-4dd4-9d62-8408b2446428 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:33.881645 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ea3ecca9-ff88-4dd4-9d62-8408b2446428 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:33.892602 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea3ecca9-ff88-4dd4-9d62-8408b2446428 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.185693 Jun 30 13:06:33.893852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 64/133] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:33 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:34.076705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:34.078414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:34.086346 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:34.088138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:34.089813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:34.090715 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:34.208896 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a5ed87c8-581c-4733-bc61-acbdfdbeb156 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:34.209625 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a5ed87c8-581c-4733-bc61-acbdfdbeb156 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:34.221413 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5ed87c8-581c-4733-bc61-acbdfdbeb156 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:34.223288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5ed87c8-581c-4733-bc61-acbdfdbeb156 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:34.224120 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5ed87c8-581c-4733-bc61-acbdfdbeb156 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:34.225674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a5ed87c8-581c-4733-bc61-acbdfdbeb156 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:34.393939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:34.409711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:34.411943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:34.413068 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ee46f8e5-4de8-4c65-8793-8fd37549864c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.340235 Jun 30 13:06:34.413639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 70/134] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:34 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:34.434627 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5e07bca2-fd81-4676-8df3-a45b97874179 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:34.435241 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5e07bca2-fd81-4676-8df3-a45b97874179 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:34.442011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5e07bca2-fd81-4676-8df3-a45b97874179 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:34.442491 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5e07bca2-fd81-4676-8df3-a45b97874179 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:34.443440 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5e07bca2-fd81-4676-8df3-a45b97874179 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:34.443947 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5e07bca2-fd81-4676-8df3-a45b97874179 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:34.502035 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a5ed87c8-581c-4733-bc61-acbdfdbeb156 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:34.531673 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a5ed87c8-581c-4733-bc61-acbdfdbeb156 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.325281 Jun 30 13:06:34.532774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 65/135] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:34 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:34.590112 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5e07bca2-fd81-4676-8df3-a45b97874179 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:34.600276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5e07bca2-fd81-4676-8df3-a45b97874179 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.185572 Jun 30 13:06:34.601608 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 71/136] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:34 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:34.912315 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ce6eaf0-ddb7-4555-9708-2ce1a2266695 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:34.913915 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ce6eaf0-ddb7-4555-9708-2ce1a2266695 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:34.924932 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ce6eaf0-ddb7-4555-9708-2ce1a2266695 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:34.927564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ce6eaf0-ddb7-4555-9708-2ce1a2266695 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:34.931949 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ce6eaf0-ddb7-4555-9708-2ce1a2266695 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:34.935562 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ce6eaf0-ddb7-4555-9708-2ce1a2266695 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:35.168308 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ce6eaf0-ddb7-4555-9708-2ce1a2266695 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:35.193038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ce6eaf0-ddb7-4555-9708-2ce1a2266695 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.287100 Jun 30 13:06:35.206596 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 66/137] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:34 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:35.433078 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:35.436086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:35.455121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:35.459194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:35.463341 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:35.464219 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:35.551382 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-21327e3f-a754-49ed-82ca-bfc57baea557 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:35.553071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-21327e3f-a754-49ed-82ca-bfc57baea557 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:35.561926 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21327e3f-a754-49ed-82ca-bfc57baea557 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:35.562769 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21327e3f-a754-49ed-82ca-bfc57baea557 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:35.563804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21327e3f-a754-49ed-82ca-bfc57baea557 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:35.564407 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-21327e3f-a754-49ed-82ca-bfc57baea557 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:35.832883 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-21327e3f-a754-49ed-82ca-bfc57baea557 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:35.847312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-21327e3f-a754-49ed-82ca-bfc57baea557 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.301302 Jun 30 13:06:35.848211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 67/138] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:35 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:35.857297 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c0f8558e-5b99-4914-88d2-29b7f32bedef tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:35.858301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c0f8558e-5b99-4914-88d2-29b7f32bedef tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:35.865712 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0f8558e-5b99-4914-88d2-29b7f32bedef tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:35.866372 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0f8558e-5b99-4914-88d2-29b7f32bedef tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:35.867271 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0f8558e-5b99-4914-88d2-29b7f32bedef tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:35.868011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0f8558e-5b99-4914-88d2-29b7f32bedef tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:36.015148 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:36.028677 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:36.030408 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:36.031633 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9886cd7d-3b3a-40f4-be81-0f4b1a4be0de tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.603711 Jun 30 13:06:36.033264 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 72/139] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:35 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:36.040555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-37446083-682e-4eaf-bd29-ec73bdfd0978 req-a51c6472-077d-469d-b6ac-2d40c5b1bf98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2c8af5-6d65-4177-9434-65a1d15813c9", "name": "network-vif-plugged", "status": "completed", "tag": "c11821df-b3b9-4d4d-9e5c-85ddf105efeb"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:36.044449 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c0f8558e-5b99-4914-88d2-29b7f32bedef tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:36.057561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c0f8558e-5b99-4914-88d2-29b7f32bedef tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.204212 Jun 30 13:06:36.059439 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 68/140] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:35 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:36.060635 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-37446083-682e-4eaf-bd29-ec73bdfd0978 req-a51c6472-077d-469d-b6ac-2d40c5b1bf98 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:36.061070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-37446083-682e-4eaf-bd29-ec73bdfd0978 req-a51c6472-077d-469d-b6ac-2d40c5b1bf98 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:36.080025 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-37446083-682e-4eaf-bd29-ec73bdfd0978 req-a51c6472-077d-469d-b6ac-2d40c5b1bf98 service nova] Creating event network-vif-plugged:c11821df-b3b9-4d4d-9e5c-85ddf105efeb for instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 on hv-cinder-81268 Jun 30 13:06:36.086604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-37446083-682e-4eaf-bd29-ec73bdfd0978 req-a51c6472-077d-469d-b6ac-2d40c5b1bf98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048841 Jun 30 13:06:36.087230 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 73/141] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:36.214014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4db2f4d4-0a50-4e0d-b487-fc25d5e1fa91 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:36.215520 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4db2f4d4-0a50-4e0d-b487-fc25d5e1fa91 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:36.222260 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db2f4d4-0a50-4e0d-b487-fc25d5e1fa91 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:36.223404 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db2f4d4-0a50-4e0d-b487-fc25d5e1fa91 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:36.224514 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db2f4d4-0a50-4e0d-b487-fc25d5e1fa91 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:36.225191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4db2f4d4-0a50-4e0d-b487-fc25d5e1fa91 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:36.436641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4db2f4d4-0a50-4e0d-b487-fc25d5e1fa91 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:36.449547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4db2f4d4-0a50-4e0d-b487-fc25d5e1fa91 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.239691 Jun 30 13:06:36.458995 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 69/142] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:36 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:36.865998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-dec40b5e-405c-495d-a79f-f4c0d5bbbe38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:36.866852 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-dec40b5e-405c-495d-a79f-f4c0d5bbbe38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:36.875834 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-dec40b5e-405c-495d-a79f-f4c0d5bbbe38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:36.876412 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-dec40b5e-405c-495d-a79f-f4c0d5bbbe38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:36.877417 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-dec40b5e-405c-495d-a79f-f4c0d5bbbe38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:36.878025 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-dec40b5e-405c-495d-a79f-f4c0d5bbbe38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:37.051040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:37.051844 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:37.059700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:37.060169 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:37.060913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:37.061330 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:37.079478 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-dec40b5e-405c-495d-a79f-f4c0d5bbbe38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:37.089139 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-dec40b5e-405c-495d-a79f-f4c0d5bbbe38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.228464 Jun 30 13:06:37.093609 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 74/143] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:36 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:37.101536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c6a48198-7393-4ec3-a6f1-fbcc4efcc59b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:37.105837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c6a48198-7393-4ec3-a6f1-fbcc4efcc59b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:37.119990 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c6a48198-7393-4ec3-a6f1-fbcc4efcc59b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:37.120792 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c6a48198-7393-4ec3-a6f1-fbcc4efcc59b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:37.122996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c6a48198-7393-4ec3-a6f1-fbcc4efcc59b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:37.124709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c6a48198-7393-4ec3-a6f1-fbcc4efcc59b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:37.313481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c6a48198-7393-4ec3-a6f1-fbcc4efcc59b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:37.323788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c6a48198-7393-4ec3-a6f1-fbcc4efcc59b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.228660 Jun 30 13:06:37.324373 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 75/144] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:37 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:37.336432 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:37.347600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:37.349488 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:37.351241 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-87a98c43-b2ef-4782-be8c-910e7db19b55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.304221 Jun 30 13:06:37.351890 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 70/145] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:37 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:06:37.467991 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-279a5b67-0e71-4a6b-a85f-a7ee35b77edd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:37.469646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-279a5b67-0e71-4a6b-a85f-a7ee35b77edd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:37.491312 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-279a5b67-0e71-4a6b-a85f-a7ee35b77edd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:37.492031 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-279a5b67-0e71-4a6b-a85f-a7ee35b77edd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:37.493044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-279a5b67-0e71-4a6b-a85f-a7ee35b77edd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:37.494056 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-279a5b67-0e71-4a6b-a85f-a7ee35b77edd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:37.724554 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-279a5b67-0e71-4a6b-a85f-a7ee35b77edd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:37.735786 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-279a5b67-0e71-4a6b-a85f-a7ee35b77edd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.273471 Jun 30 13:06:37.747159 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 76/146] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:37 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:38.112166 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14dd9d58-fc8d-4a55-8cf9-48f3ce719b38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:38.112947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-14dd9d58-fc8d-4a55-8cf9-48f3ce719b38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:38.121251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14dd9d58-fc8d-4a55-8cf9-48f3ce719b38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:38.121686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14dd9d58-fc8d-4a55-8cf9-48f3ce719b38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:38.122469 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14dd9d58-fc8d-4a55-8cf9-48f3ce719b38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:38.122894 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14dd9d58-fc8d-4a55-8cf9-48f3ce719b38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:38.297213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14dd9d58-fc8d-4a55-8cf9-48f3ce719b38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:38.307241 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14dd9d58-fc8d-4a55-8cf9-48f3ce719b38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.202075 Jun 30 13:06:38.307815 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 71/147] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:38 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:38.344139 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-03f7b59c-d7d6-483a-8868-0328228a85d0 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:38.345157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-03f7b59c-d7d6-483a-8868-0328228a85d0 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:38.352621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03f7b59c-d7d6-483a-8868-0328228a85d0 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:38.353199 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03f7b59c-d7d6-483a-8868-0328228a85d0 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:38.354202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03f7b59c-d7d6-483a-8868-0328228a85d0 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:38.354663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03f7b59c-d7d6-483a-8868-0328228a85d0 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:38.369230 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:38.369964 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:38.380502 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:38.380970 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:38.381722 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:38.382442 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:38.543599 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:38.555770 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:38.557926 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:38.559747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-96cdefcd-e7ac-425a-b33e-2bdad3281bfe tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.194285 Jun 30 13:06:38.561066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 72/148] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:38 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:06:38.737284 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-03f7b59c-d7d6-483a-8868-0328228a85d0 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:38.745744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-03f7b59c-d7d6-483a-8868-0328228a85d0 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1315 microversion: 2.1 time: 0.408131 Jun 30 13:06:38.746839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 77/149] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:38 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:38.774464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5d7a137e-d9a9-43de-a210-342b58388150 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:38.776608 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5d7a137e-d9a9-43de-a210-342b58388150 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:38.790196 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7a137e-d9a9-43de-a210-342b58388150 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:38.790888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7a137e-d9a9-43de-a210-342b58388150 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:38.791847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7a137e-d9a9-43de-a210-342b58388150 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:38.792482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d7a137e-d9a9-43de-a210-342b58388150 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:38.953585 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5d7a137e-d9a9-43de-a210-342b58388150 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:38.962579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5d7a137e-d9a9-43de-a210-342b58388150 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.203694 Jun 30 13:06:38.970889 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 73/150] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:38 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:39.325376 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-56e514ff-b994-4fef-913d-72a889ab6f35 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:39.326262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-56e514ff-b994-4fef-913d-72a889ab6f35 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:39.337409 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-56e514ff-b994-4fef-913d-72a889ab6f35 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:39.339998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-56e514ff-b994-4fef-913d-72a889ab6f35 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:39.350624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-56e514ff-b994-4fef-913d-72a889ab6f35 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:39.351853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-56e514ff-b994-4fef-913d-72a889ab6f35 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:39.544109 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-56e514ff-b994-4fef-913d-72a889ab6f35 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:39.552769 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-56e514ff-b994-4fef-913d-72a889ab6f35 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.232193 Jun 30 13:06:39.553605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 78/151] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:39 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:39.580069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:39.581655 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:39.591494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:39.592144 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:39.593166 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:39.593734 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:39.754003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:39.763970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-eeb991a9-f46a-4117-9946-fe3752790b90 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:39.764580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-eeb991a9-f46a-4117-9946-fe3752790b90 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:39.775772 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:39.777445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eeb991a9-f46a-4117-9946-fe3752790b90 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:39.777883 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eeb991a9-f46a-4117-9946-fe3752790b90 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:39.780288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:39.780770 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eeb991a9-f46a-4117-9946-fe3752790b90 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:39.781410 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eeb991a9-f46a-4117-9946-fe3752790b90 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:39.785455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5e89f54e-c436-45f7-968f-1174a570fda3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1406 microversion: 2.20 time: 0.210453 Jun 30 13:06:39.786705 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 74/152] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:39 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:39.907866 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-ae78d72d-9928-4bbf-9137-dc0944df9f40 req-2c517707-554f-4804-b929-9ffe5b43d10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10b1702-58cf-40cd-b199-96482a3f4721", "name": "network-vif-plugged", "status": "completed", "tag": "5b9dd1a2-b979-4c96-b0dc-ed91d8fe6a47"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:39.926392 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ae78d72d-9928-4bbf-9137-dc0944df9f40 req-2c517707-554f-4804-b929-9ffe5b43d10f service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:39.928048 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ae78d72d-9928-4bbf-9137-dc0944df9f40 req-2c517707-554f-4804-b929-9ffe5b43d10f service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:39.944621 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-ae78d72d-9928-4bbf-9137-dc0944df9f40 req-2c517707-554f-4804-b929-9ffe5b43d10f service nova] Creating event network-vif-plugged:5b9dd1a2-b979-4c96-b0dc-ed91d8fe6a47 for instance c10b1702-58cf-40cd-b199-96482a3f4721 on hv-cinder-81268 Jun 30 13:06:39.952874 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-ae78d72d-9928-4bbf-9137-dc0944df9f40 req-2c517707-554f-4804-b929-9ffe5b43d10f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059330 Jun 30 13:06:39.954274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 75/153] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:06:39.973307 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eeb991a9-f46a-4117-9946-fe3752790b90 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:39.984009 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-eeb991a9-f46a-4117-9946-fe3752790b90 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1501 microversion: 2.1 time: 0.223968 Jun 30 13:06:39.987806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 79/154] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:39 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:39.996586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fc1b8ca-3cb3-49c8-a74f-b23c63c18288 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:39.999950 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2fc1b8ca-3cb3-49c8-a74f-b23c63c18288 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:40.009789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fc1b8ca-3cb3-49c8-a74f-b23c63c18288 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:40.010486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fc1b8ca-3cb3-49c8-a74f-b23c63c18288 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:40.011388 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fc1b8ca-3cb3-49c8-a74f-b23c63c18288 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:40.011949 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fc1b8ca-3cb3-49c8-a74f-b23c63c18288 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:40.162231 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2fc1b8ca-3cb3-49c8-a74f-b23c63c18288 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:40.170842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2fc1b8ca-3cb3-49c8-a74f-b23c63c18288 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.184846 Jun 30 13:06:40.171362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 76/155] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:39 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:40.570008 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a9e49e6b-3361-477e-a25d-ed667e2c9c3b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:40.571282 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a9e49e6b-3361-477e-a25d-ed667e2c9c3b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:40.578415 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a9e49e6b-3361-477e-a25d-ed667e2c9c3b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:40.583680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a9e49e6b-3361-477e-a25d-ed667e2c9c3b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:40.584842 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a9e49e6b-3361-477e-a25d-ed667e2c9c3b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:40.586529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a9e49e6b-3361-477e-a25d-ed667e2c9c3b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:40.804014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:40.804544 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:40.813989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:40.814474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:40.815346 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:40.815672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:40.835106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a9e49e6b-3361-477e-a25d-ed667e2c9c3b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:40.856468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a9e49e6b-3361-477e-a25d-ed667e2c9c3b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.290587 Jun 30 13:06:40.859623 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 80/156] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:40 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:40.993332 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:41.002651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:41.004914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:41.006247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c125f29-ccbd-408a-9929-9b3b5233821d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1597 microversion: 2.20 time: 0.206538 Jun 30 13:06:41.007299 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 77/157] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:06:40 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1597 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:06:41.024959 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-82a9da54-e00d-49fc-a730-5695b8289451 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:41.025448 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-82a9da54-e00d-49fc-a730-5695b8289451 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:41.031481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-82a9da54-e00d-49fc-a730-5695b8289451 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:41.031936 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-82a9da54-e00d-49fc-a730-5695b8289451 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:41.032699 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-82a9da54-e00d-49fc-a730-5695b8289451 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:41.033126 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-82a9da54-e00d-49fc-a730-5695b8289451 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:41.176544 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-82a9da54-e00d-49fc-a730-5695b8289451 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.155383 Jun 30 13:06:41.178765 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 81/158] 10.222.0.49 () {60 vars in 1315 bytes} [Thu Jun 30 13:06:41 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 13:06:41.191495 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-858aaeda-f0e0-49c1-b771-0edfa7f2d65d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:41.192469 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-858aaeda-f0e0-49c1-b771-0edfa7f2d65d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:41.200656 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858aaeda-f0e0-49c1-b771-0edfa7f2d65d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:41.201101 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858aaeda-f0e0-49c1-b771-0edfa7f2d65d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:41.201943 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858aaeda-f0e0-49c1-b771-0edfa7f2d65d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:41.202469 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-858aaeda-f0e0-49c1-b771-0edfa7f2d65d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:41.356264 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-858aaeda-f0e0-49c1-b771-0edfa7f2d65d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:41.367909 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-858aaeda-f0e0-49c1-b771-0edfa7f2d65d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.182565 Jun 30 13:06:41.380285 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 78/159] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:41 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:41.425977 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-706b9ad7-9722-47d8-87b5-5e0b61e1ffaf tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1cd560f-fb48-495d-8d96-fc9d5fc0cb0e"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:41.427660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-706b9ad7-9722-47d8-87b5-5e0b61e1ffaf tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:41.440069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-706b9ad7-9722-47d8-87b5-5e0b61e1ffaf tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:41.442447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-706b9ad7-9722-47d8-87b5-5e0b61e1ffaf tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:41.443301 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-706b9ad7-9722-47d8-87b5-5e0b61e1ffaf tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:41.443727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-706b9ad7-9722-47d8-87b5-5e0b61e1ffaf tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:41.875223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ba7b93bb-d6f4-49e1-bf9c-81604d4c65b9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:41.876813 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ba7b93bb-d6f4-49e1-bf9c-81604d4c65b9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:41.883791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba7b93bb-d6f4-49e1-bf9c-81604d4c65b9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:41.884356 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba7b93bb-d6f4-49e1-bf9c-81604d4c65b9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:41.885215 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba7b93bb-d6f4-49e1-bf9c-81604d4c65b9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:41.885733 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba7b93bb-d6f4-49e1-bf9c-81604d4c65b9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:42.312223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ba7b93bb-d6f4-49e1-bf9c-81604d4c65b9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:42.314767 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:42.322473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ba7b93bb-d6f4-49e1-bf9c-81604d4c65b9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.450959 Jun 30 13:06:42.323296 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 79/160] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:41 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:42.333087 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-3fad949c-883d-4839-85d4-51b0371ba7ef req-decd7e8f-7b4a-4e31-963e-685e217a3075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfaf5f03-a265-481f-81c5-2f4432079c41", "name": "network-vif-plugged", "status": "completed", "tag": "3af06866-5ee3-41a6-97e5-30ef336cf968"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:42.356084 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3fad949c-883d-4839-85d4-51b0371ba7ef req-decd7e8f-7b4a-4e31-963e-685e217a3075 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:42.357277 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3fad949c-883d-4839-85d4-51b0371ba7ef req-decd7e8f-7b4a-4e31-963e-685e217a3075 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:42.370395 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-3fad949c-883d-4839-85d4-51b0371ba7ef req-decd7e8f-7b4a-4e31-963e-685e217a3075 service nova] Creating event network-vif-plugged:3af06866-5ee3-41a6-97e5-30ef336cf968 for instance bfaf5f03-a265-481f-81c5-2f4432079c41 on hv-cinder-81268 Jun 30 13:06:42.375999 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-3fad949c-883d-4839-85d4-51b0371ba7ef req-decd7e8f-7b4a-4e31-963e-685e217a3075 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051446 Jun 30 13:06:42.376857 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 80/161] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:42.387641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3c8ddd78-26eb-4e1d-ac7b-0c72eb87a0f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:42.388554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3c8ddd78-26eb-4e1d-ac7b-0c72eb87a0f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:42.397068 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c8ddd78-26eb-4e1d-ac7b-0c72eb87a0f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:42.397957 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c8ddd78-26eb-4e1d-ac7b-0c72eb87a0f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:42.398974 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c8ddd78-26eb-4e1d-ac7b-0c72eb87a0f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:42.399473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3c8ddd78-26eb-4e1d-ac7b-0c72eb87a0f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:42.566467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3c8ddd78-26eb-4e1d-ac7b-0c72eb87a0f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:42.580784 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3c8ddd78-26eb-4e1d-ac7b-0c72eb87a0f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.198542 Jun 30 13:06:42.592266 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 81/162] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:42 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:42.913453 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-b44afe52-7a89-49dc-b564-ad96a0c3b87d req-f19814a2-fb50-4e42-bc3a-5e7a3e1aeb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2c8af5-6d65-4177-9434-65a1d15813c9", "tag": "c11821df-b3b9-4d4d-9e5c-85ddf105efeb"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:42.922794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b44afe52-7a89-49dc-b564-ad96a0c3b87d req-f19814a2-fb50-4e42-bc3a-5e7a3e1aeb31 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:42.923486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-b44afe52-7a89-49dc-b564-ad96a0c3b87d req-f19814a2-fb50-4e42-bc3a-5e7a3e1aeb31 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:42.937195 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-b44afe52-7a89-49dc-b564-ad96a0c3b87d req-f19814a2-fb50-4e42-bc3a-5e7a3e1aeb31 service nova] Creating event network-changed:c11821df-b3b9-4d4d-9e5c-85ddf105efeb for instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 on hv-cinder-81268 Jun 30 13:06:42.944764 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-b44afe52-7a89-49dc-b564-ad96a0c3b87d req-f19814a2-fb50-4e42-bc3a-5e7a3e1aeb31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034303 Jun 30 13:06:42.945965 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 82/163] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:43.342225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6cf8f832-96ac-47f8-846d-71341ac71ee7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:43.342766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6cf8f832-96ac-47f8-846d-71341ac71ee7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:43.351305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cf8f832-96ac-47f8-846d-71341ac71ee7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:43.352274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cf8f832-96ac-47f8-846d-71341ac71ee7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:43.353502 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cf8f832-96ac-47f8-846d-71341ac71ee7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:43.354086 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cf8f832-96ac-47f8-846d-71341ac71ee7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:43.517542 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6cf8f832-96ac-47f8-846d-71341ac71ee7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:43.527419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6cf8f832-96ac-47f8-846d-71341ac71ee7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.189938 Jun 30 13:06:43.528675 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 83/164] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:43 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:43.599621 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e017a3ad-2da0-4063-9a04-33d6a204306e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:43.599621 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e017a3ad-2da0-4063-9a04-33d6a204306e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:43.606236 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e017a3ad-2da0-4063-9a04-33d6a204306e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:43.606777 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e017a3ad-2da0-4063-9a04-33d6a204306e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:43.607628 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e017a3ad-2da0-4063-9a04-33d6a204306e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:43.608148 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e017a3ad-2da0-4063-9a04-33d6a204306e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:43.783899 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e017a3ad-2da0-4063-9a04-33d6a204306e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:43.814223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e017a3ad-2da0-4063-9a04-33d6a204306e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.219012 Jun 30 13:06:43.815485 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 84/165] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:43 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:44.544737 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4f36e47-dd13-4a19-9ab5-9b8b9f07856e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:44.545402 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4f36e47-dd13-4a19-9ab5-9b8b9f07856e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:44.551775 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f36e47-dd13-4a19-9ab5-9b8b9f07856e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:44.552193 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f36e47-dd13-4a19-9ab5-9b8b9f07856e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:44.553287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f36e47-dd13-4a19-9ab5-9b8b9f07856e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:44.553840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f36e47-dd13-4a19-9ab5-9b8b9f07856e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:44.691860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4f36e47-dd13-4a19-9ab5-9b8b9f07856e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:44.701286 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4f36e47-dd13-4a19-9ab5-9b8b9f07856e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.160378 Jun 30 13:06:44.702028 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 85/166] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:44 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:44.832192 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-712a836f-ff1a-4812-bc92-a172a6959f7d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:44.832802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-712a836f-ff1a-4812-bc92-a172a6959f7d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:44.839087 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-712a836f-ff1a-4812-bc92-a172a6959f7d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:44.839521 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-712a836f-ff1a-4812-bc92-a172a6959f7d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:44.840774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-712a836f-ff1a-4812-bc92-a172a6959f7d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:44.841194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-712a836f-ff1a-4812-bc92-a172a6959f7d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:44.962774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:45.041466 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-712a836f-ff1a-4812-bc92-a172a6959f7d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:45.050614 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-712a836f-ff1a-4812-bc92-a172a6959f7d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.222450 Jun 30 13:06:45.051439 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 86/167] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:44 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:45.117280 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-706b9ad7-9722-47d8-87b5-5e0b61e1ffaf tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "POST /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.696045 Jun 30 13:06:45.117892 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 82/168] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:06:41 2022] POST /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a/os-volume_attachments => generated 194 bytes in 3698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:45.722345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4a658ca1-5a27-4909-9ca3-5d77ecbb3423 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:45.723195 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4a658ca1-5a27-4909-9ca3-5d77ecbb3423 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:45.730024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a658ca1-5a27-4909-9ca3-5d77ecbb3423 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:45.730601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a658ca1-5a27-4909-9ca3-5d77ecbb3423 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:45.731933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a658ca1-5a27-4909-9ca3-5d77ecbb3423 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:45.732484 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4a658ca1-5a27-4909-9ca3-5d77ecbb3423 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:45.920858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4a658ca1-5a27-4909-9ca3-5d77ecbb3423 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:45.928867 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4a658ca1-5a27-4909-9ca3-5d77ecbb3423 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.213084 Jun 30 13:06:45.930353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 87/169] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:45 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:46.067796 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e8eb349e-bf11-4a21-8d4d-f4a07cd0afe8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:46.068539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e8eb349e-bf11-4a21-8d4d-f4a07cd0afe8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:46.071501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=83 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:46.076920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e8eb349e-bf11-4a21-8d4d-f4a07cd0afe8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:46.077374 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e8eb349e-bf11-4a21-8d4d-f4a07cd0afe8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:46.078136 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e8eb349e-bf11-4a21-8d4d-f4a07cd0afe8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:46.078594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e8eb349e-bf11-4a21-8d4d-f4a07cd0afe8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:46.221454 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e8eb349e-bf11-4a21-8d4d-f4a07cd0afe8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:46.232740 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e8eb349e-bf11-4a21-8d4d-f4a07cd0afe8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.168795 Jun 30 13:06:46.234061 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 83/170] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:46 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:46.948400 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ddb3620e-f1af-4497-9343-4a8cab9f24f5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:46.949877 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ddb3620e-f1af-4497-9343-4a8cab9f24f5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:46.956427 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb3620e-f1af-4497-9343-4a8cab9f24f5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:46.956859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb3620e-f1af-4497-9343-4a8cab9f24f5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:46.957707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb3620e-f1af-4497-9343-4a8cab9f24f5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:46.958243 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ddb3620e-f1af-4497-9343-4a8cab9f24f5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:47.097283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ddb3620e-f1af-4497-9343-4a8cab9f24f5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:47.105470 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ddb3620e-f1af-4497-9343-4a8cab9f24f5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.161757 Jun 30 13:06:47.106376 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 88/171] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:46 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:06:47.253720 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-aafa38a4-a6c5-4d41-afa1-bd71c5c66d16 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:47.254464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-aafa38a4-a6c5-4d41-afa1-bd71c5c66d16 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:47.271203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aafa38a4-a6c5-4d41-afa1-bd71c5c66d16 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:47.274802 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aafa38a4-a6c5-4d41-afa1-bd71c5c66d16 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:47.276057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aafa38a4-a6c5-4d41-afa1-bd71c5c66d16 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:47.278007 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aafa38a4-a6c5-4d41-afa1-bd71c5c66d16 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:47.417537 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-aafa38a4-a6c5-4d41-afa1-bd71c5c66d16 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:47.429487 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-aafa38a4-a6c5-4d41-afa1-bd71c5c66d16 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1367 microversion: 2.1 time: 0.180061 Jun 30 13:06:47.430214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 84/172] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:47 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:48.127442 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3fd14e7a-07f0-4c9e-b164-72c73de080bc tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:48.128426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3fd14e7a-07f0-4c9e-b164-72c73de080bc tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:48.139802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fd14e7a-07f0-4c9e-b164-72c73de080bc tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:48.140507 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fd14e7a-07f0-4c9e-b164-72c73de080bc tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:48.141404 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fd14e7a-07f0-4c9e-b164-72c73de080bc tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:48.142069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3fd14e7a-07f0-4c9e-b164-72c73de080bc tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:48.283678 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3fd14e7a-07f0-4c9e-b164-72c73de080bc tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:48.291937 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3fd14e7a-07f0-4c9e-b164-72c73de080bc tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1362 microversion: 2.1 time: 0.170409 Jun 30 13:06:48.292587 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 89/173] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:48 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:48.447041 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5c37bec1-ce9c-429e-aa2c-3f1351109602 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:48.447643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5c37bec1-ce9c-429e-aa2c-3f1351109602 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:48.458234 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5c37bec1-ce9c-429e-aa2c-3f1351109602 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:48.458516 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5c37bec1-ce9c-429e-aa2c-3f1351109602 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:48.459619 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5c37bec1-ce9c-429e-aa2c-3f1351109602 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:48.459869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5c37bec1-ce9c-429e-aa2c-3f1351109602 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:48.688718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5c37bec1-ce9c-429e-aa2c-3f1351109602 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:48.699165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5c37bec1-ce9c-429e-aa2c-3f1351109602 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1557 microversion: 2.1 time: 0.256104 Jun 30 13:06:48.719423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10f7ab12-33e2-42f1-977d-6bff83f1c891 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:48.720178 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10f7ab12-33e2-42f1-977d-6bff83f1c891 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:48.720314 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 85/174] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:48 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1557 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:48.731383 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10f7ab12-33e2-42f1-977d-6bff83f1c891 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:48.732264 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10f7ab12-33e2-42f1-977d-6bff83f1c891 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:48.733088 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10f7ab12-33e2-42f1-977d-6bff83f1c891 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:48.733518 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10f7ab12-33e2-42f1-977d-6bff83f1c891 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:48.879318 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10f7ab12-33e2-42f1-977d-6bff83f1c891 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165854 Jun 30 13:06:48.879948 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 90/175] 10.222.0.49 () {58 vars in 1274 bytes} [Thu Jun 30 13:06:48 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:49.311566 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c75189bf-0db2-4740-951e-b673ace67e86 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:49.312699 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c75189bf-0db2-4740-951e-b673ace67e86 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:49.319513 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c75189bf-0db2-4740-951e-b673ace67e86 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:49.320061 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c75189bf-0db2-4740-951e-b673ace67e86 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:49.320873 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c75189bf-0db2-4740-951e-b673ace67e86 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:49.321378 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c75189bf-0db2-4740-951e-b673ace67e86 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:49.505880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c75189bf-0db2-4740-951e-b673ace67e86 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:49.516293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c75189bf-0db2-4740-951e-b673ace67e86 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1548 microversion: 2.1 time: 0.210398 Jun 30 13:06:49.516797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 86/176] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:49 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1548 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:49.534978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-487d5867-5bcd-46ef-868e-bcaaab2f8cbe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:49.535592 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-487d5867-5bcd-46ef-868e-bcaaab2f8cbe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:49.543933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-487d5867-5bcd-46ef-868e-bcaaab2f8cbe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:49.544832 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-487d5867-5bcd-46ef-868e-bcaaab2f8cbe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:49.545870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-487d5867-5bcd-46ef-868e-bcaaab2f8cbe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:49.546521 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-487d5867-5bcd-46ef-868e-bcaaab2f8cbe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:49.821219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-487d5867-5bcd-46ef-868e-bcaaab2f8cbe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.287281 Jun 30 13:06:49.821219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 91/177] 10.222.0.49 () {58 vars in 1274 bytes} [Thu Jun 30 13:06:49 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/os-interface => generated 285 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:50.514297 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-717efb34-4936-4076-a862-00b74700aeca req-083dbee0-dde2-48f2-8ab0-c1e34a5c2450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10b1702-58cf-40cd-b199-96482a3f4721", "tag": "5b9dd1a2-b979-4c96-b0dc-ed91d8fe6a47"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:50.534003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-717efb34-4936-4076-a862-00b74700aeca req-083dbee0-dde2-48f2-8ab0-c1e34a5c2450 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:50.534639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-717efb34-4936-4076-a862-00b74700aeca req-083dbee0-dde2-48f2-8ab0-c1e34a5c2450 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:50.564010 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-717efb34-4936-4076-a862-00b74700aeca req-083dbee0-dde2-48f2-8ab0-c1e34a5c2450 service nova] Creating event network-changed:5b9dd1a2-b979-4c96-b0dc-ed91d8fe6a47 for instance c10b1702-58cf-40cd-b199-96482a3f4721 on hv-cinder-81268 Jun 30 13:06:50.578429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-717efb34-4936-4076-a862-00b74700aeca req-083dbee0-dde2-48f2-8ab0-c1e34a5c2450 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068496 Jun 30 13:06:50.579245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 87/178] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:51.687067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-afcedfe7-4413-4df9-89b7-c50363d8ef09 req-04d26d2b-0873-42c9-8bd0-80c6a33a17cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfaf5f03-a265-481f-81c5-2f4432079c41", "tag": "3af06866-5ee3-41a6-97e5-30ef336cf968"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:51.701278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-afcedfe7-4413-4df9-89b7-c50363d8ef09 req-04d26d2b-0873-42c9-8bd0-80c6a33a17cf service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:51.702181 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-afcedfe7-4413-4df9-89b7-c50363d8ef09 req-04d26d2b-0873-42c9-8bd0-80c6a33a17cf service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:51.741781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-afcedfe7-4413-4df9-89b7-c50363d8ef09 req-04d26d2b-0873-42c9-8bd0-80c6a33a17cf service nova] Creating event network-changed:3af06866-5ee3-41a6-97e5-30ef336cf968 for instance bfaf5f03-a265-481f-81c5-2f4432079c41 on hv-cinder-81268 Jun 30 13:06:51.761278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-afcedfe7-4413-4df9-89b7-c50363d8ef09 req-04d26d2b-0873-42c9-8bd0-80c6a33a17cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077722 Jun 30 13:06:51.767994 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 92/179] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:06:56.119633 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1d2df24c-7b1f-4410-a4f3-f6266d3c631b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:56.120476 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1d2df24c-7b1f-4410-a4f3-f6266d3c631b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:56.127302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1d2df24c-7b1f-4410-a4f3-f6266d3c631b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:56.127811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1d2df24c-7b1f-4410-a4f3-f6266d3c631b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:56.128630 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1d2df24c-7b1f-4410-a4f3-f6266d3c631b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:56.129121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1d2df24c-7b1f-4410-a4f3-f6266d3c631b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:56.159734 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1d2df24c-7b1f-4410-a4f3-f6266d3c631b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:06:56.253695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1d2df24c-7b1f-4410-a4f3-f6266d3c631b tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 204 len: 0 microversion: 2.1 time: 0.138752 Jun 30 13:06:56.254878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 88/180] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:06:56 2022] DELETE /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:06:56.268643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-67f051c3-1606-4359-961a-96eb62ba1692 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:56.270007 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-67f051c3-1606-4359-961a-96eb62ba1692 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:56.272686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=96 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.279596 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67f051c3-1606-4359-961a-96eb62ba1692 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:56.280142 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67f051c3-1606-4359-961a-96eb62ba1692 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:56.280878 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67f051c3-1606-4359-961a-96eb62ba1692 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:56.281302 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-67f051c3-1606-4359-961a-96eb62ba1692 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:56.435998 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-67f051c3-1606-4359-961a-96eb62ba1692 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:56.447123 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-67f051c3-1606-4359-961a-96eb62ba1692 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1553 microversion: 2.1 time: 0.186658 Jun 30 13:06:56.448140 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 93/181] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:56 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:57.465960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3e590f95-5af2-450f-82dd-308108125f79 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:57.466761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3e590f95-5af2-450f-82dd-308108125f79 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:57.474047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3e590f95-5af2-450f-82dd-308108125f79 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:57.474498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3e590f95-5af2-450f-82dd-308108125f79 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:57.475253 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3e590f95-5af2-450f-82dd-308108125f79 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:57.475669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3e590f95-5af2-450f-82dd-308108125f79 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:57.613912 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3e590f95-5af2-450f-82dd-308108125f79 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:57.625097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3e590f95-5af2-450f-82dd-308108125f79 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1553 microversion: 2.1 time: 0.163453 Jun 30 13:06:57.625803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 89/182] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:57 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:58.643295 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c22f6338-14ea-475d-a5a0-b3afbd144bbe tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:58.644518 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c22f6338-14ea-475d-a5a0-b3afbd144bbe tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:58.651174 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c22f6338-14ea-475d-a5a0-b3afbd144bbe tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:58.652065 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c22f6338-14ea-475d-a5a0-b3afbd144bbe tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:58.652776 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c22f6338-14ea-475d-a5a0-b3afbd144bbe tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:58.653221 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c22f6338-14ea-475d-a5a0-b3afbd144bbe tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:58.841643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c22f6338-14ea-475d-a5a0-b3afbd144bbe tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:06:58.850835 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c22f6338-14ea-475d-a5a0-b3afbd144bbe tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1553 microversion: 2.1 time: 0.212080 Jun 30 13:06:58.851436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 94/183] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:58 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:06:59.868835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d3ac660c-c669-4398-8180-c0ea9ba3b4dd tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:06:59.869444 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d3ac660c-c669-4398-8180-c0ea9ba3b4dd tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:06:59.882824 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d3ac660c-c669-4398-8180-c0ea9ba3b4dd tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:59.884293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d3ac660c-c669-4398-8180-c0ea9ba3b4dd tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:59.885451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d3ac660c-c669-4398-8180-c0ea9ba3b4dd tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:59.886877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d3ac660c-c669-4398-8180-c0ea9ba3b4dd tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:59.920101 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-ec6475cc-c9d0-4077-b4f4-95c7646b38a5 req-c7156f66-5cea-4731-a653-6b121db6d5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a", "name": "network-vif-deleted", "tag": "5e348e74-5afb-4473-a462-d6f5bfc34ce3"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:06:59.937879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ec6475cc-c9d0-4077-b4f4-95c7646b38a5 req-c7156f66-5cea-4731-a653-6b121db6d5b8 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:06:59.939857 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ec6475cc-c9d0-4077-b4f4-95c7646b38a5 req-c7156f66-5cea-4731-a653-6b121db6d5b8 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:06:59.961486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-ec6475cc-c9d0-4077-b4f4-95c7646b38a5 req-c7156f66-5cea-4731-a653-6b121db6d5b8 service nova] Creating event network-vif-deleted:5e348e74-5afb-4473-a462-d6f5bfc34ce3 for instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a on hv-cinder-81268 Jun 30 13:06:59.969275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-ec6475cc-c9d0-4077-b4f4-95c7646b38a5 req-c7156f66-5cea-4731-a653-6b121db6d5b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053472 Jun 30 13:06:59.970857 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 95/184] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:07:00.016193 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d3ac660c-c669-4398-8180-c0ea9ba3b4dd tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:00.035407 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d3ac660c-c669-4398-8180-c0ea9ba3b4dd tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1511 microversion: 2.1 time: 0.168396 Jun 30 13:07:00.046038 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 90/185] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:06:59 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:01.054853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:01.056226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:01.068193 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:01.069129 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:01.070188 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:01.070917 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:01.116234 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:01.117003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:01.118475 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lazy-loading 'fault' on Instance uuid 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:07:01.180102 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e84715279114df09ecfe4335c926066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988a6aa0bbb045bb9b66810219206ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:01.187942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3b18e917-bad9-4e61-b9cd-32753bead453 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 200 len: 1305 microversion: 2.1 time: 0.137846 Jun 30 13:07:01.188624 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 96/186] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:01 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:02.208829 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:02.209558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:02.216689 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:02.217118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:02.217854 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:02.218256 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:02.231660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] HTTP exception thrown: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Request method failure captured: Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a HTTP/1.1 Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-09jUjkGviNbF7rWk9ghd1aq748OShoozUMMbsYwZkCdPt0QTnLOtbHv39stWIWKKnE5cozssrXIWH8CEbLJNDeXOiI6I00OafyWouPsg5oRXfxpfFkbLCO0dUBium4w_aJhzqBkOzZjZRwITcY_4xDmPbLjYMPePX_97U-TfnybI Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 988a6aa0bbb045bb9b66810219206ebc Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:07:02.236351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/988a6aa0bbb045bb9b66810219206ebc"}]}] Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 988a6aa0bbb045bb9b66810219206ebc Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-DeleteServersTestJSON-301945628-project Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 2e84715279114df09ecfe4335c926066 Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-DeleteServersTestJSON-301945628-project Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.237777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a'} Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:07:02.238604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.240044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.241464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Returning 404 to user: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:07:02.241464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f96a064a-d044-4ae9-8dcf-e8c3ae3181a3 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 404 len: 111 microversion: 2.1 time: 0.035151 Jun 30 13:07:02.241464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 91/187] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:02 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:07:02.345556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:02.346524 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:02.352807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:02.353235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:02.353977 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:02.354500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:02.368084 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] HTTP exception thrown: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Request method failure captured: Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a/os-volume_attachments HTTP/1.1 Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-09jUjkGviNbF7rWk9ghd1aq748OShoozUMMbsYwZkCdPt0QTnLOtbHv39stWIWKKnE5cozssrXIWH8CEbLJNDeXOiI6I00OafyWouPsg5oRXfxpfFkbLCO0dUBium4w_aJhzqBkOzZjZRwITcY_4xDmPbLjYMPePX_97U-TfnybI Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 988a6aa0bbb045bb9b66810219206ebc Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:07:02.372228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/988a6aa0bbb045bb9b66810219206ebc"}]}] Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 988a6aa0bbb045bb9b66810219206ebc Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-DeleteServersTestJSON-301945628-project Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 2e84715279114df09ecfe4335c926066 Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-DeleteServersTestJSON-301945628-project Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.373576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a'} Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:07:02.374547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:02.375888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:02.377206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Returning 404 to user: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:07:02.377206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-782148dd-f5a0-44a0-8479-76b8ed65e7d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032034 Jun 30 13:07:02.377206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 97/188] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:07:02 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:07:10.964426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:10.965231 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:10.972670 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:10.973117 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:10.973871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:10.974297 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:10.989056 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] HTTP exception thrown: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Request method failure captured: Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a HTTP/1.1 Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-09jUjkGviNbF7rWk9ghd1aq748OShoozUMMbsYwZkCdPt0QTnLOtbHv39stWIWKKnE5cozssrXIWH8CEbLJNDeXOiI6I00OafyWouPsg5oRXfxpfFkbLCO0dUBium4w_aJhzqBkOzZjZRwITcY_4xDmPbLjYMPePX_97U-TfnybI Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 988a6aa0bbb045bb9b66810219206ebc Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:07:10.990624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/988a6aa0bbb045bb9b66810219206ebc"}]}] Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 988a6aa0bbb045bb9b66810219206ebc Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-DeleteServersTestJSON-301945628-project Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 2e84715279114df09ecfe4335c926066 Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-DeleteServersTestJSON-301945628-project Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:10.992146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a'} Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:07:10.992920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:10.994121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:07:10.996003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Returning 404 to user: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:07:10.996003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c93c57d1-998b-4e50-b500-4dd4bdd655d5 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 404 len: 111 microversion: 2.1 time: 0.031519 Jun 30 13:07:10.996003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 92/189] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:07:10 2022] DELETE /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:07:11.000871 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:11.001508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] [instance: 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:11.007878 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:11.008314 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:11.009061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:11.009481 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:11.023012 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] HTTP exception thrown: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Request method failure captured: Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a HTTP/1.1 Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-09jUjkGviNbF7rWk9ghd1aq748OShoozUMMbsYwZkCdPt0QTnLOtbHv39stWIWKKnE5cozssrXIWH8CEbLJNDeXOiI6I00OafyWouPsg5oRXfxpfFkbLCO0dUBium4w_aJhzqBkOzZjZRwITcY_4xDmPbLjYMPePX_97U-TfnybI Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 988a6aa0bbb045bb9b66810219206ebc Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:07:11.025107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_988a6aa0bbb045bb9b66810219206ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/988a6aa0bbb045bb9b66810219206ebc"}]}] Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 988a6aa0bbb045bb9b66810219206ebc Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-DeleteServersTestJSON-301945628 Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-DeleteServersTestJSON-301945628-project Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 2e84715279114df09ecfe4335c926066 Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-DeleteServersTestJSON-301945628-project Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:11.026572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a'} Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:07:11.027322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. Jun 30 13:07:11.031912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:07:11.032938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] Returning 404 to user: Instance 5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:07:11.032938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-89038d4d-4331-424c-87b1-00ac4eba2425 tempest-DeleteServersTestJSON-301945628 tempest-DeleteServersTestJSON-301945628-project] 10.222.0.49 "GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a" status: 404 len: 111 microversion: 2.1 time: 0.029786 Jun 30 13:07:11.032938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 98/190] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:10 2022] GET /compute/v2.1/servers/5ebbf35b-4ecb-4ed9-929d-0f3da9d59c5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:07:20.691142 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-994849633", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:07:20.697886 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:20.757429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] validate_networks() for [('120ca554-5550-41aa-ba84-8c9f590c4e34', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:07:20.978865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:21.154509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:07:21.154924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:07:21.155416 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:07:21.155810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:07:21.156208 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:07:21.165526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:21.165958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:21.166801 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:21.167223 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:21.184535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Getting quotas for project 792f217e834c4049b5b0d856cd53f947. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:07:21.188424 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Getting quotas for user a7ce962e4a7447848e3454905102d27c and project 792f217e834c4049b5b0d856cd53f947. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:07:21.199765 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:07:21.202163 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:07:21.252464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5825f66f-81c9-4f82-bc8a-9e3f8c166bb4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.683938 Jun 30 13:07:21.253419 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 93/191] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:07:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:07:21.263357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0da7260f-ead6-412f-b04e-bb32b09bdc14 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:21.263948 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0da7260f-ead6-412f-b04e-bb32b09bdc14 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:21.267457 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=13 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:21.269366 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=89 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:21.324818 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0da7260f-ead6-412f-b04e-bb32b09bdc14 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:21.332670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0da7260f-ead6-412f-b04e-bb32b09bdc14 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1221 microversion: 2.1 time: 0.072852 Jun 30 13:07:21.346801 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 99/192] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:21 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:21.390051 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1248011790", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:07:21.444214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] validate_networks() for [('120ca554-5550-41aa-ba84-8c9f590c4e34', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:07:22.088127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:07:22.088702 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:07:22.089052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:07:22.089539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:07:22.090312 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:07:22.099924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:22.100392 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:22.101173 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:22.101595 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:22.118209 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Getting quotas for project 792f217e834c4049b5b0d856cd53f947. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:07:22.121969 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Getting quotas for user a7ce962e4a7447848e3454905102d27c and project 792f217e834c4049b5b0d856cd53f947. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:07:22.132847 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:07:22.135082 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:07:22.182355 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b52516bd-225e-4169-9bea-5232b5fa3854 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.796612 Jun 30 13:07:22.182999 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 94/193] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:07:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:07:22.192965 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fc543dc1-f044-4483-a853-3f8aa5504d5d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:22.193601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fc543dc1-f044-4483-a853-3f8aa5504d5d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:22.283588 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fc543dc1-f044-4483-a853-3f8aa5504d5d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:22.293673 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fc543dc1-f044-4483-a853-3f8aa5504d5d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1222 microversion: 2.1 time: 0.104187 Jun 30 13:07:22.298615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 100/194] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:22 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:23.312334 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-721bc9ff-8415-4e1c-abec-2bba3d8633f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:23.320090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-721bc9ff-8415-4e1c-abec-2bba3d8633f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:23.328849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-721bc9ff-8415-4e1c-abec-2bba3d8633f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:23.329451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-721bc9ff-8415-4e1c-abec-2bba3d8633f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:23.330712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-721bc9ff-8415-4e1c-abec-2bba3d8633f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:23.331228 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-721bc9ff-8415-4e1c-abec-2bba3d8633f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:23.417482 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-721bc9ff-8415-4e1c-abec-2bba3d8633f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:23.428339 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-721bc9ff-8415-4e1c-abec-2bba3d8633f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1226 microversion: 2.1 time: 0.121127 Jun 30 13:07:23.429330 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 95/195] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:23 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:24.446381 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6227a968-961a-4b82-83be-5409356ae8b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:24.446988 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6227a968-961a-4b82-83be-5409356ae8b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:24.453409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6227a968-961a-4b82-83be-5409356ae8b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:24.453851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6227a968-961a-4b82-83be-5409356ae8b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:24.454644 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6227a968-961a-4b82-83be-5409356ae8b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:24.455053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6227a968-961a-4b82-83be-5409356ae8b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:24.523764 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6227a968-961a-4b82-83be-5409356ae8b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:24.531489 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6227a968-961a-4b82-83be-5409356ae8b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1226 microversion: 2.1 time: 0.089022 Jun 30 13:07:24.532015 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 101/196] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:24 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:25.549753 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-eaa5af94-7651-483a-bd3c-c9be5c461912 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:25.550860 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-eaa5af94-7651-483a-bd3c-c9be5c461912 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:25.559158 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eaa5af94-7651-483a-bd3c-c9be5c461912 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:25.559596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eaa5af94-7651-483a-bd3c-c9be5c461912 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:25.560342 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eaa5af94-7651-483a-bd3c-c9be5c461912 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:25.560746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eaa5af94-7651-483a-bd3c-c9be5c461912 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:25.626285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eaa5af94-7651-483a-bd3c-c9be5c461912 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:25.633782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-eaa5af94-7651-483a-bd3c-c9be5c461912 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1226 microversion: 2.1 time: 0.089188 Jun 30 13:07:25.634449 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 96/197] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:25 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:26.655522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0a3e64bc-7b2b-4301-98e0-97d9644bd7b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:26.656146 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0a3e64bc-7b2b-4301-98e0-97d9644bd7b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:26.662496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a3e64bc-7b2b-4301-98e0-97d9644bd7b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:26.662935 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a3e64bc-7b2b-4301-98e0-97d9644bd7b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:26.663678 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a3e64bc-7b2b-4301-98e0-97d9644bd7b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:26.664095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0a3e64bc-7b2b-4301-98e0-97d9644bd7b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:26.724671 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0a3e64bc-7b2b-4301-98e0-97d9644bd7b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:26.732341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0a3e64bc-7b2b-4301-98e0-97d9644bd7b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1274 microversion: 2.1 time: 0.080747 Jun 30 13:07:26.732906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 102/198] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:26 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:07:27.429579 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-d041375e-60a1-46e1-9f65-11d0bb8be97e req-3e400615-3a4f-4363-a0dc-39c5fe00b902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227d6c05-e0fc-477e-a03e-cf5160212c76", "tag": "569d371d-6431-4ca3-b618-9b53f8f12f0f"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:07:27.440709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-d041375e-60a1-46e1-9f65-11d0bb8be97e req-3e400615-3a4f-4363-a0dc-39c5fe00b902 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:27.441193 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-d041375e-60a1-46e1-9f65-11d0bb8be97e req-3e400615-3a4f-4363-a0dc-39c5fe00b902 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:27.460961 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-d041375e-60a1-46e1-9f65-11d0bb8be97e req-3e400615-3a4f-4363-a0dc-39c5fe00b902 service nova] Creating event network-changed:569d371d-6431-4ca3-b618-9b53f8f12f0f for instance 227d6c05-e0fc-477e-a03e-cf5160212c76 on hv-cinder-81268 Jun 30 13:07:27.468926 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-d041375e-60a1-46e1-9f65-11d0bb8be97e req-3e400615-3a4f-4363-a0dc-39c5fe00b902 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041860 Jun 30 13:07:27.474860 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 97/199] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:07:27.749177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-94da44aa-8aef-4898-96eb-4c9fd57cc776 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:27.749786 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-94da44aa-8aef-4898-96eb-4c9fd57cc776 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:27.764359 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94da44aa-8aef-4898-96eb-4c9fd57cc776 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:27.764804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94da44aa-8aef-4898-96eb-4c9fd57cc776 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:27.765854 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94da44aa-8aef-4898-96eb-4c9fd57cc776 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:27.766281 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94da44aa-8aef-4898-96eb-4c9fd57cc776 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:27.954082 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-94da44aa-8aef-4898-96eb-4c9fd57cc776 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:27.964201 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-94da44aa-8aef-4898-96eb-4c9fd57cc776 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.217972 Jun 30 13:07:27.967770 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 103/200] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:27 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:28.640093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-3e38d85c-1c13-4ad6-8f64-822b900303a4 req-baccffae-6938-43c7-855f-dedc13e8a318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711b43e6-7228-4df7-83dc-7c52bc321cee", "tag": "610276b3-7f63-41a6-a116-42955224eed0"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:07:28.654538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3e38d85c-1c13-4ad6-8f64-822b900303a4 req-baccffae-6938-43c7-855f-dedc13e8a318 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:28.656430 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3e38d85c-1c13-4ad6-8f64-822b900303a4 req-baccffae-6938-43c7-855f-dedc13e8a318 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:28.677932 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-3e38d85c-1c13-4ad6-8f64-822b900303a4 req-baccffae-6938-43c7-855f-dedc13e8a318 service nova] Creating event network-changed:610276b3-7f63-41a6-a116-42955224eed0 for instance 711b43e6-7228-4df7-83dc-7c52bc321cee on hv-cinder-81268 Jun 30 13:07:28.683465 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-3e38d85c-1c13-4ad6-8f64-822b900303a4 req-baccffae-6938-43c7-855f-dedc13e8a318 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048207 Jun 30 13:07:28.684121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 98/201] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:07:28.984735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-abff171d-b786-4a46-a2b8-ddef7677e6c2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:28.985261 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-abff171d-b786-4a46-a2b8-ddef7677e6c2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:28.991989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abff171d-b786-4a46-a2b8-ddef7677e6c2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:28.992426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abff171d-b786-4a46-a2b8-ddef7677e6c2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:28.993173 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abff171d-b786-4a46-a2b8-ddef7677e6c2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:28.993593 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abff171d-b786-4a46-a2b8-ddef7677e6c2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:29.129704 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-abff171d-b786-4a46-a2b8-ddef7677e6c2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:29.142180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-abff171d-b786-4a46-a2b8-ddef7677e6c2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.161165 Jun 30 13:07:29.142970 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 104/202] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:28 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:30.163904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-70963ee0-10a0-4d1e-9624-f866d3aaab62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:30.164771 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-70963ee0-10a0-4d1e-9624-f866d3aaab62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:30.171642 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-70963ee0-10a0-4d1e-9624-f866d3aaab62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:30.172290 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-70963ee0-10a0-4d1e-9624-f866d3aaab62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:30.173092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-70963ee0-10a0-4d1e-9624-f866d3aaab62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:30.173576 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-70963ee0-10a0-4d1e-9624-f866d3aaab62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:30.308469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-70963ee0-10a0-4d1e-9624-f866d3aaab62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:30.317049 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-70963ee0-10a0-4d1e-9624-f866d3aaab62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.158046 Jun 30 13:07:30.317633 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 99/203] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:30 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:31.334244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-129abc81-81d1-4845-a018-3a4285f61920 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:31.334981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-129abc81-81d1-4845-a018-3a4285f61920 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:31.341742 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-129abc81-81d1-4845-a018-3a4285f61920 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:31.342187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-129abc81-81d1-4845-a018-3a4285f61920 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:31.343190 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-129abc81-81d1-4845-a018-3a4285f61920 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:31.343627 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-129abc81-81d1-4845-a018-3a4285f61920 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:31.488505 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-129abc81-81d1-4845-a018-3a4285f61920 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:31.497147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-129abc81-81d1-4845-a018-3a4285f61920 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.166747 Jun 30 13:07:31.497812 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 105/204] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:31 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:32.514501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ed3cb801-6138-4ed8-b6d4-2c2be42a4cca tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:32.515216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ed3cb801-6138-4ed8-b6d4-2c2be42a4cca tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:32.520762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=4 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.520762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=12 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:32.524836 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed3cb801-6138-4ed8-b6d4-2c2be42a4cca tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:32.525273 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed3cb801-6138-4ed8-b6d4-2c2be42a4cca tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:32.526065 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed3cb801-6138-4ed8-b6d4-2c2be42a4cca tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:32.526538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed3cb801-6138-4ed8-b6d4-2c2be42a4cca tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:32.681507 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ed3cb801-6138-4ed8-b6d4-2c2be42a4cca tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:32.689290 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ed3cb801-6138-4ed8-b6d4-2c2be42a4cca tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.178815 Jun 30 13:07:32.689851 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 100/205] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:32 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:33.707425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fae2dfb5-7d48-4821-a67b-500e3e749ebf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:33.708004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fae2dfb5-7d48-4821-a67b-500e3e749ebf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:33.710582 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:33.718701 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fae2dfb5-7d48-4821-a67b-500e3e749ebf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:33.719803 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fae2dfb5-7d48-4821-a67b-500e3e749ebf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:33.721152 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fae2dfb5-7d48-4821-a67b-500e3e749ebf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:33.721574 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fae2dfb5-7d48-4821-a67b-500e3e749ebf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:33.875480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fae2dfb5-7d48-4821-a67b-500e3e749ebf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:33.883041 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fae2dfb5-7d48-4821-a67b-500e3e749ebf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.179910 Jun 30 13:07:33.883611 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 106/206] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:33 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:34.900317 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c2336961-d7cf-4ea2-a55e-dbfce3cdfa2c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:34.900923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c2336961-d7cf-4ea2-a55e-dbfce3cdfa2c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:34.908284 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2336961-d7cf-4ea2-a55e-dbfce3cdfa2c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:34.908725 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2336961-d7cf-4ea2-a55e-dbfce3cdfa2c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:34.909479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2336961-d7cf-4ea2-a55e-dbfce3cdfa2c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:34.909904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2336961-d7cf-4ea2-a55e-dbfce3cdfa2c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:35.149757 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c2336961-d7cf-4ea2-a55e-dbfce3cdfa2c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:35.158236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c2336961-d7cf-4ea2-a55e-dbfce3cdfa2c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.261793 Jun 30 13:07:35.158772 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 101/207] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:34 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:35.971208 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-f81987f8-f79a-4be3-951d-db81349cd7f9 req-9574e042-c12e-4b18-a9fb-0c21291ee32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227d6c05-e0fc-477e-a03e-cf5160212c76", "name": "network-vif-plugged", "status": "completed", "tag": "569d371d-6431-4ca3-b618-9b53f8f12f0f"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:07:35.980099 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f81987f8-f79a-4be3-951d-db81349cd7f9 req-9574e042-c12e-4b18-a9fb-0c21291ee32e service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:35.980540 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f81987f8-f79a-4be3-951d-db81349cd7f9 req-9574e042-c12e-4b18-a9fb-0c21291ee32e service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:35.996242 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-f81987f8-f79a-4be3-951d-db81349cd7f9 req-9574e042-c12e-4b18-a9fb-0c21291ee32e service nova] Creating event network-vif-plugged:569d371d-6431-4ca3-b618-9b53f8f12f0f for instance 227d6c05-e0fc-477e-a03e-cf5160212c76 on hv-cinder-81268 Jun 30 13:07:36.001830 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-f81987f8-f79a-4be3-951d-db81349cd7f9 req-9574e042-c12e-4b18-a9fb-0c21291ee32e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034480 Jun 30 13:07:36.002509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 107/208] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:07:36.176102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7ca34c8a-6c46-4ba6-9348-460192aec2a6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:36.176734 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7ca34c8a-6c46-4ba6-9348-460192aec2a6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:36.183584 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7ca34c8a-6c46-4ba6-9348-460192aec2a6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:36.184018 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7ca34c8a-6c46-4ba6-9348-460192aec2a6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:36.184836 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7ca34c8a-6c46-4ba6-9348-460192aec2a6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:36.185315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7ca34c8a-6c46-4ba6-9348-460192aec2a6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:36.377119 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7ca34c8a-6c46-4ba6-9348-460192aec2a6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:36.384657 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7ca34c8a-6c46-4ba6-9348-460192aec2a6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.212830 Jun 30 13:07:36.385209 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 102/209] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:36 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:37.402727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d2441472-3360-4ebd-a611-a7b4d2aaac04 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:37.403421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d2441472-3360-4ebd-a611-a7b4d2aaac04 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:37.410570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2441472-3360-4ebd-a611-a7b4d2aaac04 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:37.411011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2441472-3360-4ebd-a611-a7b4d2aaac04 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:37.411770 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2441472-3360-4ebd-a611-a7b4d2aaac04 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:37.412173 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d2441472-3360-4ebd-a611-a7b4d2aaac04 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:37.550066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d2441472-3360-4ebd-a611-a7b4d2aaac04 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:37.557772 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d2441472-3360-4ebd-a611-a7b4d2aaac04 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.159298 Jun 30 13:07:37.558342 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 108/210] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:37 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:38.386240 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-e601b592-b48d-420e-95b6-44df8dd4c9d4 req-768d9486-d145-4d94-a5e7-746fc569d4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711b43e6-7228-4df7-83dc-7c52bc321cee", "name": "network-vif-plugged", "status": "completed", "tag": "610276b3-7f63-41a6-a116-42955224eed0"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:07:38.396163 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-e601b592-b48d-420e-95b6-44df8dd4c9d4 req-768d9486-d145-4d94-a5e7-746fc569d4c3 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:38.396577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-e601b592-b48d-420e-95b6-44df8dd4c9d4 req-768d9486-d145-4d94-a5e7-746fc569d4c3 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:38.410447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-e601b592-b48d-420e-95b6-44df8dd4c9d4 req-768d9486-d145-4d94-a5e7-746fc569d4c3 service nova] Creating event network-vif-plugged:610276b3-7f63-41a6-a116-42955224eed0 for instance 711b43e6-7228-4df7-83dc-7c52bc321cee on hv-cinder-81268 Jun 30 13:07:38.415658 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-e601b592-b48d-420e-95b6-44df8dd4c9d4 req-768d9486-d145-4d94-a5e7-746fc569d4c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033157 Jun 30 13:07:38.416240 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 103/211] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:07:38.579241 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3a7d0f19-2dc5-4501-82bd-2a2a9ee39b42 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:38.580178 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3a7d0f19-2dc5-4501-82bd-2a2a9ee39b42 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:38.590788 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a7d0f19-2dc5-4501-82bd-2a2a9ee39b42 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:38.591499 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a7d0f19-2dc5-4501-82bd-2a2a9ee39b42 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:38.592760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a7d0f19-2dc5-4501-82bd-2a2a9ee39b42 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:38.593434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3a7d0f19-2dc5-4501-82bd-2a2a9ee39b42 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:38.728638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3a7d0f19-2dc5-4501-82bd-2a2a9ee39b42 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:38.736700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3a7d0f19-2dc5-4501-82bd-2a2a9ee39b42 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.163570 Jun 30 13:07:38.737317 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 109/212] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:38 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:39.755358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f2a6903e-989a-4206-83ed-71596fad6e13 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:39.756077 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f2a6903e-989a-4206-83ed-71596fad6e13 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:39.762868 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f2a6903e-989a-4206-83ed-71596fad6e13 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:39.763300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f2a6903e-989a-4206-83ed-71596fad6e13 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:39.764055 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f2a6903e-989a-4206-83ed-71596fad6e13 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:39.764478 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f2a6903e-989a-4206-83ed-71596fad6e13 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:39.895572 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f2a6903e-989a-4206-83ed-71596fad6e13 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:39.903612 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f2a6903e-989a-4206-83ed-71596fad6e13 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.152989 Jun 30 13:07:39.904178 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 104/213] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:39 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:40.921300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16df2563-dc94-43b9-8ec5-ea6d67280e8f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:40.921878 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16df2563-dc94-43b9-8ec5-ea6d67280e8f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:40.928709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16df2563-dc94-43b9-8ec5-ea6d67280e8f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:40.929147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16df2563-dc94-43b9-8ec5-ea6d67280e8f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:40.929918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16df2563-dc94-43b9-8ec5-ea6d67280e8f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:40.930376 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16df2563-dc94-43b9-8ec5-ea6d67280e8f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:41.063262 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16df2563-dc94-43b9-8ec5-ea6d67280e8f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:41.072522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16df2563-dc94-43b9-8ec5-ea6d67280e8f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1322 microversion: 2.1 time: 0.155326 Jun 30 13:07:41.073077 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 110/214] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:40 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:42.091047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7c222847-70e8-4ad4-ad75-0ec52c359281 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:42.091613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7c222847-70e8-4ad4-ad75-0ec52c359281 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:42.098225 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c222847-70e8-4ad4-ad75-0ec52c359281 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:42.098677 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c222847-70e8-4ad4-ad75-0ec52c359281 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:42.099543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c222847-70e8-4ad4-ad75-0ec52c359281 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:42.099962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c222847-70e8-4ad4-ad75-0ec52c359281 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:42.239974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7c222847-70e8-4ad4-ad75-0ec52c359281 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:42.248814 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7c222847-70e8-4ad4-ad75-0ec52c359281 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1517 microversion: 2.1 time: 0.162287 Jun 30 13:07:42.249382 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 105/215] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:42 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:42.266379 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-24d6ea0c-a817-4f34-b09d-912e6ba3e8f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:07:42.268284 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-24d6ea0c-a817-4f34-b09d-912e6ba3e8f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:42.276855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24d6ea0c-a817-4f34-b09d-912e6ba3e8f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:42.277287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24d6ea0c-a817-4f34-b09d-912e6ba3e8f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:42.278398 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24d6ea0c-a817-4f34-b09d-912e6ba3e8f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:42.279051 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-24d6ea0c-a817-4f34-b09d-912e6ba3e8f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:42.306564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-24d6ea0c-a817-4f34-b09d-912e6ba3e8f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lazy-loading 'flavor' on Instance uuid 711b43e6-7228-4df7-83dc-7c52bc321cee {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:07:42.441375 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-24d6ea0c-a817-4f34-b09d-912e6ba3e8f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee/action" status: 200 len: 32 microversion: 2.1 time: 0.178957 Jun 30 13:07:42.441893 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 111/216] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:07:42 2022] POST /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:07:42.451466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7aea2ea1-52ed-4962-91b6-ccdbb5339f82 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:42.452074 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7aea2ea1-52ed-4962-91b6-ccdbb5339f82 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:42.458965 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7aea2ea1-52ed-4962-91b6-ccdbb5339f82 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:42.459453 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7aea2ea1-52ed-4962-91b6-ccdbb5339f82 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:42.463226 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7aea2ea1-52ed-4962-91b6-ccdbb5339f82 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:42.463226 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7aea2ea1-52ed-4962-91b6-ccdbb5339f82 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:42.704273 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7aea2ea1-52ed-4962-91b6-ccdbb5339f82 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:42.716842 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7aea2ea1-52ed-4962-91b6-ccdbb5339f82 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.269535 Jun 30 13:07:42.717435 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 106/217] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:42 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:43.736398 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fe25f071-9f81-4b1b-b671-87d665eae1de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:43.737079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fe25f071-9f81-4b1b-b671-87d665eae1de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:43.745631 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe25f071-9f81-4b1b-b671-87d665eae1de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:43.746067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe25f071-9f81-4b1b-b671-87d665eae1de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:43.746862 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe25f071-9f81-4b1b-b671-87d665eae1de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:43.747282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fe25f071-9f81-4b1b-b671-87d665eae1de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:43.892910 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fe25f071-9f81-4b1b-b671-87d665eae1de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:43.900717 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fe25f071-9f81-4b1b-b671-87d665eae1de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.169369 Jun 30 13:07:43.901304 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 112/218] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:43 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:44.921063 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b5c09d21-0668-4c0f-a302-d19c2f6ea490 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:44.921692 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b5c09d21-0668-4c0f-a302-d19c2f6ea490 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:44.930797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b5c09d21-0668-4c0f-a302-d19c2f6ea490 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:44.931231 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b5c09d21-0668-4c0f-a302-d19c2f6ea490 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:44.931971 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b5c09d21-0668-4c0f-a302-d19c2f6ea490 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:44.932384 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b5c09d21-0668-4c0f-a302-d19c2f6ea490 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:45.073167 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b5c09d21-0668-4c0f-a302-d19c2f6ea490 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:45.080734 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b5c09d21-0668-4c0f-a302-d19c2f6ea490 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.165772 Jun 30 13:07:45.081562 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 107/219] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:44 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:46.099131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b95c7af0-02e6-496f-958a-05dcdbac9f52 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:46.099667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b95c7af0-02e6-496f-958a-05dcdbac9f52 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:46.106115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b95c7af0-02e6-496f-958a-05dcdbac9f52 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:46.106592 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b95c7af0-02e6-496f-958a-05dcdbac9f52 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:46.107341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b95c7af0-02e6-496f-958a-05dcdbac9f52 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:46.107756 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b95c7af0-02e6-496f-958a-05dcdbac9f52 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:46.251757 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b95c7af0-02e6-496f-958a-05dcdbac9f52 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:46.260635 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b95c7af0-02e6-496f-958a-05dcdbac9f52 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.165410 Jun 30 13:07:46.261201 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 113/220] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:46 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:47.277333 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3273a948-44af-4e5c-b223-49582bdd6e0f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:47.277979 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3273a948-44af-4e5c-b223-49582bdd6e0f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:47.285130 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3273a948-44af-4e5c-b223-49582bdd6e0f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:47.285567 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3273a948-44af-4e5c-b223-49582bdd6e0f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:47.286337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3273a948-44af-4e5c-b223-49582bdd6e0f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:47.286795 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3273a948-44af-4e5c-b223-49582bdd6e0f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:47.428058 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3273a948-44af-4e5c-b223-49582bdd6e0f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:47.436717 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3273a948-44af-4e5c-b223-49582bdd6e0f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.163446 Jun 30 13:07:47.437289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 108/221] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:47 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:48.454475 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2322d700-effb-4011-8eba-80af5597f2cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:48.455101 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2322d700-effb-4011-8eba-80af5597f2cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:48.461907 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2322d700-effb-4011-8eba-80af5597f2cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:48.462349 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2322d700-effb-4011-8eba-80af5597f2cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:48.463123 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2322d700-effb-4011-8eba-80af5597f2cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:48.463541 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2322d700-effb-4011-8eba-80af5597f2cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:48.604961 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2322d700-effb-4011-8eba-80af5597f2cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:48.612980 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2322d700-effb-4011-8eba-80af5597f2cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.162410 Jun 30 13:07:48.613568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 114/222] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:48 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:49.633684 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cd8f9f4c-5ad8-47ee-814a-a177d37d0139 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:49.634592 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cd8f9f4c-5ad8-47ee-814a-a177d37d0139 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:49.644276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cd8f9f4c-5ad8-47ee-814a-a177d37d0139 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:49.644907 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cd8f9f4c-5ad8-47ee-814a-a177d37d0139 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:49.645974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cd8f9f4c-5ad8-47ee-814a-a177d37d0139 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:49.646629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cd8f9f4c-5ad8-47ee-814a-a177d37d0139 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:49.787270 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cd8f9f4c-5ad8-47ee-814a-a177d37d0139 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:49.797619 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cd8f9f4c-5ad8-47ee-814a-a177d37d0139 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.169491 Jun 30 13:07:49.798177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 109/223] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:49 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:50.817643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8134a6a8-c781-4fc5-b9e7-16c76b548168 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:50.818511 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8134a6a8-c781-4fc5-b9e7-16c76b548168 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:50.827929 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8134a6a8-c781-4fc5-b9e7-16c76b548168 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:50.828545 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8134a6a8-c781-4fc5-b9e7-16c76b548168 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:50.829601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8134a6a8-c781-4fc5-b9e7-16c76b548168 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:50.830194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8134a6a8-c781-4fc5-b9e7-16c76b548168 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:50.969501 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8134a6a8-c781-4fc5-b9e7-16c76b548168 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:50.977137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8134a6a8-c781-4fc5-b9e7-16c76b548168 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.165880 Jun 30 13:07:50.977700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 115/224] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:50 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:51.997997 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7857c73d-7296-45ed-9acb-c2b3e15be452 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:51.999061 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7857c73d-7296-45ed-9acb-c2b3e15be452 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:52.002887 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:52.012063 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7857c73d-7296-45ed-9acb-c2b3e15be452 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:52.012774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7857c73d-7296-45ed-9acb-c2b3e15be452 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:52.014004 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7857c73d-7296-45ed-9acb-c2b3e15be452 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:52.014962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7857c73d-7296-45ed-9acb-c2b3e15be452 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:52.018565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=83 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:52.150683 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7857c73d-7296-45ed-9acb-c2b3e15be452 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:52.159503 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7857c73d-7296-45ed-9acb-c2b3e15be452 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.167852 Jun 30 13:07:52.160095 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 110/225] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:51 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:53.182182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2a0c93c-5d18-49d2-a43e-d5d0f6af7f4a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:53.183203 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2a0c93c-5d18-49d2-a43e-d5d0f6af7f4a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:53.186623 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=39 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:53.194559 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2a0c93c-5d18-49d2-a43e-d5d0f6af7f4a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:53.195140 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2a0c93c-5d18-49d2-a43e-d5d0f6af7f4a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:53.196229 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2a0c93c-5d18-49d2-a43e-d5d0f6af7f4a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:53.196671 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2a0c93c-5d18-49d2-a43e-d5d0f6af7f4a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:53.201119 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:53.347683 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2a0c93c-5d18-49d2-a43e-d5d0f6af7f4a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:53.355298 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2a0c93c-5d18-49d2-a43e-d5d0f6af7f4a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.179562 Jun 30 13:07:53.355855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 116/226] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:53 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:54.376771 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ffc4dbee-4ee0-4c75-9017-00b52a4f3395 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:54.377806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ffc4dbee-4ee0-4c75-9017-00b52a4f3395 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:54.388934 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ffc4dbee-4ee0-4c75-9017-00b52a4f3395 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:54.389997 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ffc4dbee-4ee0-4c75-9017-00b52a4f3395 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:54.392584 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ffc4dbee-4ee0-4c75-9017-00b52a4f3395 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:54.393018 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ffc4dbee-4ee0-4c75-9017-00b52a4f3395 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:54.525218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ffc4dbee-4ee0-4c75-9017-00b52a4f3395 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:54.533438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ffc4dbee-4ee0-4c75-9017-00b52a4f3395 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.163193 Jun 30 13:07:54.534009 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 111/227] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:54 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:55.555656 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a23781db-2d17-4b40-a89e-d60907a344db tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:55.556533 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a23781db-2d17-4b40-a89e-d60907a344db tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:55.565030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a23781db-2d17-4b40-a89e-d60907a344db tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:55.565490 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a23781db-2d17-4b40-a89e-d60907a344db tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:55.566233 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a23781db-2d17-4b40-a89e-d60907a344db tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:55.566683 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a23781db-2d17-4b40-a89e-d60907a344db tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:55.701863 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a23781db-2d17-4b40-a89e-d60907a344db tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:55.710598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a23781db-2d17-4b40-a89e-d60907a344db tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.161603 Jun 30 13:07:55.711169 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 117/228] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:55 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:56.728165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-df188d6a-4bff-4643-8bdc-8a7cc73ffc37 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:56.728773 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-df188d6a-4bff-4643-8bdc-8a7cc73ffc37 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:56.735756 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-df188d6a-4bff-4643-8bdc-8a7cc73ffc37 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:56.736196 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-df188d6a-4bff-4643-8bdc-8a7cc73ffc37 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:56.736953 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-df188d6a-4bff-4643-8bdc-8a7cc73ffc37 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:56.737392 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-df188d6a-4bff-4643-8bdc-8a7cc73ffc37 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:56.870604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-df188d6a-4bff-4643-8bdc-8a7cc73ffc37 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:56.878518 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-df188d6a-4bff-4643-8bdc-8a7cc73ffc37 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.154083 Jun 30 13:07:56.879082 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 112/229] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:56 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:57.896826 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d8316e1-25bd-441a-8f1c-478692f72862 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:57.897468 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d8316e1-25bd-441a-8f1c-478692f72862 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:57.904606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d8316e1-25bd-441a-8f1c-478692f72862 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:57.905084 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d8316e1-25bd-441a-8f1c-478692f72862 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:57.906239 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d8316e1-25bd-441a-8f1c-478692f72862 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:57.906593 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d8316e1-25bd-441a-8f1c-478692f72862 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:58.040774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8d8316e1-25bd-441a-8f1c-478692f72862 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:58.048799 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d8316e1-25bd-441a-8f1c-478692f72862 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.156264 Jun 30 13:07:58.049344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 118/230] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:57 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:07:59.070539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-75f67cf8-069b-4e9f-afa4-0f16af7d9528 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:07:59.071199 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-75f67cf8-069b-4e9f-afa4-0f16af7d9528 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:07:59.079679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-75f67cf8-069b-4e9f-afa4-0f16af7d9528 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:59.080526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-75f67cf8-069b-4e9f-afa4-0f16af7d9528 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:59.081443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-75f67cf8-069b-4e9f-afa4-0f16af7d9528 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:07:59.081971 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-75f67cf8-069b-4e9f-afa4-0f16af7d9528 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:07:59.217187 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-75f67cf8-069b-4e9f-afa4-0f16af7d9528 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:07:59.225228 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-75f67cf8-069b-4e9f-afa4-0f16af7d9528 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.159395 Jun 30 13:07:59.225801 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 113/231] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:07:59 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:00.243265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-10176afe-4b3b-4a69-adef-c12d165e75e1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:00.244578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-10176afe-4b3b-4a69-adef-c12d165e75e1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:00.251721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10176afe-4b3b-4a69-adef-c12d165e75e1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:00.252200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10176afe-4b3b-4a69-adef-c12d165e75e1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:00.253021 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10176afe-4b3b-4a69-adef-c12d165e75e1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:00.253483 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-10176afe-4b3b-4a69-adef-c12d165e75e1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:00.617414 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-10176afe-4b3b-4a69-adef-c12d165e75e1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:00.625594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-10176afe-4b3b-4a69-adef-c12d165e75e1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.386377 Jun 30 13:08:00.626349 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 119/232] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:00 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:01.644397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7504eb8f-a4ad-4af2-862f-ddc8511e4e39 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:01.644984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7504eb8f-a4ad-4af2-862f-ddc8511e4e39 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:01.652135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7504eb8f-a4ad-4af2-862f-ddc8511e4e39 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:01.652563 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7504eb8f-a4ad-4af2-862f-ddc8511e4e39 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:01.653306 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7504eb8f-a4ad-4af2-862f-ddc8511e4e39 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:01.653745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7504eb8f-a4ad-4af2-862f-ddc8511e4e39 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:01.787580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7504eb8f-a4ad-4af2-862f-ddc8511e4e39 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:01.795808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7504eb8f-a4ad-4af2-862f-ddc8511e4e39 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.155478 Jun 30 13:08:01.796575 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 114/233] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:01 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:02.813315 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3413a82d-7357-4297-b6f6-4f2c2b35c9fe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:02.813943 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3413a82d-7357-4297-b6f6-4f2c2b35c9fe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:02.820612 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3413a82d-7357-4297-b6f6-4f2c2b35c9fe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:02.821049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3413a82d-7357-4297-b6f6-4f2c2b35c9fe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:02.821791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3413a82d-7357-4297-b6f6-4f2c2b35c9fe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:02.822207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3413a82d-7357-4297-b6f6-4f2c2b35c9fe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:02.955544 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3413a82d-7357-4297-b6f6-4f2c2b35c9fe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:02.963701 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3413a82d-7357-4297-b6f6-4f2c2b35c9fe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.154323 Jun 30 13:08:02.964272 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 120/234] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:02 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:03.984579 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4c686a59-7f10-4a22-ba7a-49ed225b98b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:03.985185 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4c686a59-7f10-4a22-ba7a-49ed225b98b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:03.992014 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c686a59-7f10-4a22-ba7a-49ed225b98b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:03.992443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c686a59-7f10-4a22-ba7a-49ed225b98b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:03.993192 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c686a59-7f10-4a22-ba7a-49ed225b98b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:03.993613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c686a59-7f10-4a22-ba7a-49ed225b98b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:04.141927 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4c686a59-7f10-4a22-ba7a-49ed225b98b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:04.149907 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4c686a59-7f10-4a22-ba7a-49ed225b98b7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.171468 Jun 30 13:08:04.150494 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 115/235] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:03 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:05.167676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4913fffb-e93e-4ff1-aa8f-da9923498dac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:05.168250 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4913fffb-e93e-4ff1-aa8f-da9923498dac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:05.174657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4913fffb-e93e-4ff1-aa8f-da9923498dac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:05.175097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4913fffb-e93e-4ff1-aa8f-da9923498dac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:05.175848 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4913fffb-e93e-4ff1-aa8f-da9923498dac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:05.176263 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4913fffb-e93e-4ff1-aa8f-da9923498dac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:05.314952 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4913fffb-e93e-4ff1-aa8f-da9923498dac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:05.326581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4913fffb-e93e-4ff1-aa8f-da9923498dac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.162525 Jun 30 13:08:05.327500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 121/236] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:05 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:06.345197 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-10865377-3032-409d-b25f-ab8cce048909 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:06.346103 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-10865377-3032-409d-b25f-ab8cce048909 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:06.353281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-10865377-3032-409d-b25f-ab8cce048909 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:06.353713 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-10865377-3032-409d-b25f-ab8cce048909 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:06.354498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-10865377-3032-409d-b25f-ab8cce048909 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:06.354921 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-10865377-3032-409d-b25f-ab8cce048909 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:06.489166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-10865377-3032-409d-b25f-ab8cce048909 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:06.497279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-10865377-3032-409d-b25f-ab8cce048909 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.156106 Jun 30 13:08:06.497849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 116/237] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:06 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:07.514927 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-632284fe-ab2a-43e5-840c-64e282a6b079 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:07.515526 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-632284fe-ab2a-43e5-840c-64e282a6b079 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:07.522233 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-632284fe-ab2a-43e5-840c-64e282a6b079 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:07.522702 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-632284fe-ab2a-43e5-840c-64e282a6b079 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:07.523458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-632284fe-ab2a-43e5-840c-64e282a6b079 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:07.523879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-632284fe-ab2a-43e5-840c-64e282a6b079 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:07.665700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-632284fe-ab2a-43e5-840c-64e282a6b079 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:07.673819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-632284fe-ab2a-43e5-840c-64e282a6b079 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.162783 Jun 30 13:08:07.674414 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 122/238] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:07 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:08.691390 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0909723f-d8f3-4171-b372-9b6e97e89a65 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:08.691887 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0909723f-d8f3-4171-b372-9b6e97e89a65 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:08.700409 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0909723f-d8f3-4171-b372-9b6e97e89a65 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:08.700842 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0909723f-d8f3-4171-b372-9b6e97e89a65 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:08.701598 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0909723f-d8f3-4171-b372-9b6e97e89a65 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:08.702018 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0909723f-d8f3-4171-b372-9b6e97e89a65 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:08.837072 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0909723f-d8f3-4171-b372-9b6e97e89a65 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:08.845221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0909723f-d8f3-4171-b372-9b6e97e89a65 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.158033 Jun 30 13:08:08.845781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 117/239] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:08 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:08:09.863037 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00828dae-6393-490e-b5d8-e46e2c87f8f4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:09.863639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00828dae-6393-490e-b5d8-e46e2c87f8f4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:09.869909 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00828dae-6393-490e-b5d8-e46e2c87f8f4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:09.870519 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00828dae-6393-490e-b5d8-e46e2c87f8f4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:09.871269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00828dae-6393-490e-b5d8-e46e2c87f8f4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:09.871690 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00828dae-6393-490e-b5d8-e46e2c87f8f4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:10.008117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-00828dae-6393-490e-b5d8-e46e2c87f8f4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:10.015766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00828dae-6393-490e-b5d8-e46e2c87f8f4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.156738 Jun 30 13:08:10.016332 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 123/240] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:09 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:11.035881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-13cfce79-502b-4e2c-a728-cb0090f59823 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:11.036408 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-13cfce79-502b-4e2c-a728-cb0090f59823 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:11.044998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-13cfce79-502b-4e2c-a728-cb0090f59823 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:11.045442 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-13cfce79-502b-4e2c-a728-cb0090f59823 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:11.046192 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-13cfce79-502b-4e2c-a728-cb0090f59823 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:11.046644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-13cfce79-502b-4e2c-a728-cb0090f59823 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:11.181188 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-13cfce79-502b-4e2c-a728-cb0090f59823 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:11.188871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-13cfce79-502b-4e2c-a728-cb0090f59823 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.159368 Jun 30 13:08:11.189445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 118/241] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:11 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:12.209473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e42c8f05-c589-4a8c-977a-f04526cf64df tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:12.210509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e42c8f05-c589-4a8c-977a-f04526cf64df tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:12.220004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e42c8f05-c589-4a8c-977a-f04526cf64df tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:12.220747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e42c8f05-c589-4a8c-977a-f04526cf64df tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:12.221998 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e42c8f05-c589-4a8c-977a-f04526cf64df tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:12.222739 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e42c8f05-c589-4a8c-977a-f04526cf64df tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:12.375849 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e42c8f05-c589-4a8c-977a-f04526cf64df tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:12.384147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e42c8f05-c589-4a8c-977a-f04526cf64df tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.180936 Jun 30 13:08:12.384706 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 124/242] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:12 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:13.406778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-79699c64-935e-41da-b371-fff93a5a5064 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:13.407635 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-79699c64-935e-41da-b371-fff93a5a5064 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:13.418028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79699c64-935e-41da-b371-fff93a5a5064 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:13.419076 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79699c64-935e-41da-b371-fff93a5a5064 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:13.420337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79699c64-935e-41da-b371-fff93a5a5064 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:13.421052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79699c64-935e-41da-b371-fff93a5a5064 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:13.565226 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-79699c64-935e-41da-b371-fff93a5a5064 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:13.573324 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-79699c64-935e-41da-b371-fff93a5a5064 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.173841 Jun 30 13:08:13.573924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 119/243] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:13 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:14.600688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0f92cb89-7e29-48fc-b1f6-1a3279457f2e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:14.601562 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0f92cb89-7e29-48fc-b1f6-1a3279457f2e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:14.609756 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f92cb89-7e29-48fc-b1f6-1a3279457f2e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:14.610193 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f92cb89-7e29-48fc-b1f6-1a3279457f2e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:14.610968 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f92cb89-7e29-48fc-b1f6-1a3279457f2e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:14.611383 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0f92cb89-7e29-48fc-b1f6-1a3279457f2e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:14.753853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0f92cb89-7e29-48fc-b1f6-1a3279457f2e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:14.761610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0f92cb89-7e29-48fc-b1f6-1a3279457f2e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.167470 Jun 30 13:08:14.762178 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 125/244] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:14 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:15.779097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1ef7de49-69b8-419e-876d-a77eac154536 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:15.779660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1ef7de49-69b8-419e-876d-a77eac154536 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:15.786823 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1ef7de49-69b8-419e-876d-a77eac154536 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:15.787259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1ef7de49-69b8-419e-876d-a77eac154536 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:15.788011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1ef7de49-69b8-419e-876d-a77eac154536 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:15.788432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1ef7de49-69b8-419e-876d-a77eac154536 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:15.923783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1ef7de49-69b8-419e-876d-a77eac154536 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:15.931476 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1ef7de49-69b8-419e-876d-a77eac154536 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.156379 Jun 30 13:08:15.932047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 120/245] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:15 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:16.952289 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11c9257e-13e9-408e-a1bb-5a8e968965e9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:16.953075 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11c9257e-13e9-408e-a1bb-5a8e968965e9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:16.961119 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11c9257e-13e9-408e-a1bb-5a8e968965e9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:16.961668 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11c9257e-13e9-408e-a1bb-5a8e968965e9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:16.962657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11c9257e-13e9-408e-a1bb-5a8e968965e9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:16.963192 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11c9257e-13e9-408e-a1bb-5a8e968965e9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:17.103276 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-11c9257e-13e9-408e-a1bb-5a8e968965e9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:17.111338 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11c9257e-13e9-408e-a1bb-5a8e968965e9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.164953 Jun 30 13:08:17.111911 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 126/246] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:16 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:18.129175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ebb08d7d-1bbf-47d1-b9b8-6b0932c6d985 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:18.129763 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ebb08d7d-1bbf-47d1-b9b8-6b0932c6d985 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:18.136931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ebb08d7d-1bbf-47d1-b9b8-6b0932c6d985 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:18.137332 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ebb08d7d-1bbf-47d1-b9b8-6b0932c6d985 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:18.138114 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ebb08d7d-1bbf-47d1-b9b8-6b0932c6d985 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:18.138566 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ebb08d7d-1bbf-47d1-b9b8-6b0932c6d985 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:18.276550 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ebb08d7d-1bbf-47d1-b9b8-6b0932c6d985 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:18.284680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ebb08d7d-1bbf-47d1-b9b8-6b0932c6d985 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.159336 Jun 30 13:08:18.285281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 121/247] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:18 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:19.301782 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2fcad4ee-73ce-4bc6-8a97-93c95d154ca3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:19.302425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2fcad4ee-73ce-4bc6-8a97-93c95d154ca3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:19.308766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fcad4ee-73ce-4bc6-8a97-93c95d154ca3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:19.309221 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fcad4ee-73ce-4bc6-8a97-93c95d154ca3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:19.310627 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fcad4ee-73ce-4bc6-8a97-93c95d154ca3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:19.311058 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2fcad4ee-73ce-4bc6-8a97-93c95d154ca3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:19.445526 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2fcad4ee-73ce-4bc6-8a97-93c95d154ca3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:19.453559 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2fcad4ee-73ce-4bc6-8a97-93c95d154ca3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.155529 Jun 30 13:08:19.454196 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 127/248] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:19 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:20.473469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fbeb83fd-acb3-43b7-85ff-05333ef78872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:20.474070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fbeb83fd-acb3-43b7-85ff-05333ef78872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:20.483830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fbeb83fd-acb3-43b7-85ff-05333ef78872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:20.484265 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fbeb83fd-acb3-43b7-85ff-05333ef78872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:20.485210 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fbeb83fd-acb3-43b7-85ff-05333ef78872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:20.485801 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fbeb83fd-acb3-43b7-85ff-05333ef78872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:20.758413 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fbeb83fd-acb3-43b7-85ff-05333ef78872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:20.767478 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fbeb83fd-acb3-43b7-85ff-05333ef78872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.297390 Jun 30 13:08:20.768428 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 122/249] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:20 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:21.784484 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e85e28a8-3740-4828-8831-64c39115a905 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:21.785206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e85e28a8-3740-4828-8831-64c39115a905 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:21.791680 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e85e28a8-3740-4828-8831-64c39115a905 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:21.792115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e85e28a8-3740-4828-8831-64c39115a905 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:21.792872 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e85e28a8-3740-4828-8831-64c39115a905 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:21.793291 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e85e28a8-3740-4828-8831-64c39115a905 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:21.924765 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e85e28a8-3740-4828-8831-64c39115a905 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:21.933905 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e85e28a8-3740-4828-8831-64c39115a905 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.152804 Jun 30 13:08:21.934912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 128/250] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:21 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:22.279894 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-476079080", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "networks": [{"uuid": "49e5b1d1-626a-41bc-8749-76436a8ee8b4"}]}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:22.286947 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=26 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:22.339085 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] validate_networks() for [('49e5b1d1-626a-41bc-8749-76436a8ee8b4', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:08:22.710011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:08:22.710461 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:08:22.710925 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:08:22.711324 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:08:22.711751 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:08:22.721946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:22.722418 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:22.723203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:22.723627 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:22.729426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=78 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:22.742997 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Getting quotas for project 22b3073c2c6f4f479aae8d37cccc7ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:08:22.747390 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Getting quotas for user 79388c8109554a82b6336fd8c803005f and project 22b3073c2c6f4f479aae8d37cccc7ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:08:22.760004 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:08:22.762276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:08:22.814103 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d7102869-1ea1-494b-ad22-8dbb464a120b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538040 Jun 30 13:08:22.814964 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 123/251] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:08:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:08:22.827886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9894f7b8-932a-4826-96d4-5c89eeb6367e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:22.828558 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9894f7b8-932a-4826-96d4-5c89eeb6367e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:22.888742 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9894f7b8-932a-4826-96d4-5c89eeb6367e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:22.895917 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9894f7b8-932a-4826-96d4-5c89eeb6367e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1218 microversion: 2.1 time: 0.072117 Jun 30 13:08:22.896721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 129/252] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:22 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:08:22.951930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe86c505-b358-4579-a2ac-8e0dcd30111a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:22.952600 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fe86c505-b358-4579-a2ac-8e0dcd30111a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:22.958908 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe86c505-b358-4579-a2ac-8e0dcd30111a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:22.959346 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe86c505-b358-4579-a2ac-8e0dcd30111a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:22.960273 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe86c505-b358-4579-a2ac-8e0dcd30111a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:22.960689 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe86c505-b358-4579-a2ac-8e0dcd30111a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:23.103461 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fe86c505-b358-4579-a2ac-8e0dcd30111a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:23.113584 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fe86c505-b358-4579-a2ac-8e0dcd30111a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1523 microversion: 2.1 time: 0.165188 Jun 30 13:08:23.122901 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 124/253] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:22 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:23.916719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a9867d1c-59bb-46db-8d43-f6be20986b3b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:23.917704 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a9867d1c-59bb-46db-8d43-f6be20986b3b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:23.920343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=30 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:23.926118 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9867d1c-59bb-46db-8d43-f6be20986b3b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:23.926580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9867d1c-59bb-46db-8d43-f6be20986b3b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:23.927332 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9867d1c-59bb-46db-8d43-f6be20986b3b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:23.927753 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a9867d1c-59bb-46db-8d43-f6be20986b3b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:23.930297 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=78 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:23.990691 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a9867d1c-59bb-46db-8d43-f6be20986b3b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:23.998831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a9867d1c-59bb-46db-8d43-f6be20986b3b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1222 microversion: 2.1 time: 0.088678 Jun 30 13:08:23.999398 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 130/254] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:23 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:24.133987 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-149eb19b-3ef1-4343-918f-557d686721aa tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:24.134988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-149eb19b-3ef1-4343-918f-557d686721aa tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:24.143867 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-149eb19b-3ef1-4343-918f-557d686721aa tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:24.144327 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-149eb19b-3ef1-4343-918f-557d686721aa tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:24.145081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-149eb19b-3ef1-4343-918f-557d686721aa tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:24.145498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-149eb19b-3ef1-4343-918f-557d686721aa tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:24.282678 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-149eb19b-3ef1-4343-918f-557d686721aa tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:24.291133 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-149eb19b-3ef1-4343-918f-557d686721aa tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1503 microversion: 2.1 time: 0.163601 Jun 30 13:08:24.291700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 125/255] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:24 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:24.307618 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f34b794b-5779-4e07-8fff-d14b1b1f6e23 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:24.308225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f34b794b-5779-4e07-8fff-d14b1b1f6e23 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:24.315350 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f34b794b-5779-4e07-8fff-d14b1b1f6e23 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:24.315788 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f34b794b-5779-4e07-8fff-d14b1b1f6e23 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:24.316544 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f34b794b-5779-4e07-8fff-d14b1b1f6e23 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:24.316962 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f34b794b-5779-4e07-8fff-d14b1b1f6e23 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:24.461665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f34b794b-5779-4e07-8fff-d14b1b1f6e23 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:24.471067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f34b794b-5779-4e07-8fff-d14b1b1f6e23 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1515 microversion: 2.1 time: 0.167396 Jun 30 13:08:24.471635 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 131/256] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:24 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:25.020232 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0f85a35c-313d-4323-aea0-187a6a3c5a63 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:25.021083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0f85a35c-313d-4323-aea0-187a6a3c5a63 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:25.031922 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0f85a35c-313d-4323-aea0-187a6a3c5a63 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:25.032638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0f85a35c-313d-4323-aea0-187a6a3c5a63 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:25.033869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0f85a35c-313d-4323-aea0-187a6a3c5a63 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:25.034614 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0f85a35c-313d-4323-aea0-187a6a3c5a63 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:25.102622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0f85a35c-313d-4323-aea0-187a6a3c5a63 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:25.110249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0f85a35c-313d-4323-aea0-187a6a3c5a63 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1222 microversion: 2.1 time: 0.096840 Jun 30 13:08:25.110848 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 126/257] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:25 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:26.130955 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c441ed6d-d680-4b81-974f-543b3fdbb9e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:26.131624 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c441ed6d-d680-4b81-974f-543b3fdbb9e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:26.141105 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c441ed6d-d680-4b81-974f-543b3fdbb9e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:26.141588 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c441ed6d-d680-4b81-974f-543b3fdbb9e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:26.142470 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c441ed6d-d680-4b81-974f-543b3fdbb9e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:26.142912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c441ed6d-d680-4b81-974f-543b3fdbb9e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:26.209144 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c441ed6d-d680-4b81-974f-543b3fdbb9e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:26.220091 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c441ed6d-d680-4b81-974f-543b3fdbb9e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1222 microversion: 2.1 time: 0.095901 Jun 30 13:08:26.220670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 132/258] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:26 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:27.237466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3bc33c38-d64e-4d1c-a01e-9b6362c6a7a7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:27.238083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3bc33c38-d64e-4d1c-a01e-9b6362c6a7a7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:27.245990 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3bc33c38-d64e-4d1c-a01e-9b6362c6a7a7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:27.246513 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3bc33c38-d64e-4d1c-a01e-9b6362c6a7a7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:27.247304 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3bc33c38-d64e-4d1c-a01e-9b6362c6a7a7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:27.247727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3bc33c38-d64e-4d1c-a01e-9b6362c6a7a7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:27.319899 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3bc33c38-d64e-4d1c-a01e-9b6362c6a7a7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:27.332869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3bc33c38-d64e-4d1c-a01e-9b6362c6a7a7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1288 microversion: 2.1 time: 0.096126 Jun 30 13:08:27.337197 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 127/259] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:27 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:27.949103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27fca267-de52-42b2-97de-67b7d6d69bdb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:27.950190 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27fca267-de52-42b2-97de-67b7d6d69bdb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:27.956592 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fca267-de52-42b2-97de-67b7d6d69bdb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:27.957023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fca267-de52-42b2-97de-67b7d6d69bdb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:27.957765 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fca267-de52-42b2-97de-67b7d6d69bdb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:27.958183 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27fca267-de52-42b2-97de-67b7d6d69bdb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:27.982698 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-27fca267-de52-42b2-97de-67b7d6d69bdb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lazy-loading 'flavor' on Instance uuid 227d6c05-e0fc-477e-a03e-cf5160212c76 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:08:28.063055 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27fca267-de52-42b2-97de-67b7d6d69bdb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76/action" status: 200 len: 32 microversion: 2.1 time: 0.116612 Jun 30 13:08:28.063883 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 133/260] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:08:27 2022] POST /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:08:28.073196 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4c00117a-6802-4598-b23e-efeb4f243615 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:28.074076 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4c00117a-6802-4598-b23e-efeb4f243615 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:28.082307 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c00117a-6802-4598-b23e-efeb4f243615 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:28.083046 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c00117a-6802-4598-b23e-efeb4f243615 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:28.084072 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c00117a-6802-4598-b23e-efeb4f243615 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:28.084604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c00117a-6802-4598-b23e-efeb4f243615 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:28.283738 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4c00117a-6802-4598-b23e-efeb4f243615 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:28.291492 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4c00117a-6802-4598-b23e-efeb4f243615 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.222457 Jun 30 13:08:28.302238 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 128/261] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:28 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:28.353811 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a13aeeb3-63d8-41d3-b626-0d72491f587f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:28.354800 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a13aeeb3-63d8-41d3-b626-0d72491f587f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:28.361139 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a13aeeb3-63d8-41d3-b626-0d72491f587f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:28.361572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a13aeeb3-63d8-41d3-b626-0d72491f587f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:28.362352 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a13aeeb3-63d8-41d3-b626-0d72491f587f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:28.362767 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a13aeeb3-63d8-41d3-b626-0d72491f587f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:28.562408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a13aeeb3-63d8-41d3-b626-0d72491f587f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:28.571523 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a13aeeb3-63d8-41d3-b626-0d72491f587f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.222150 Jun 30 13:08:28.572335 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 134/262] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:28 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:28.853469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-52972c51-3c5d-44b1-b6bb-acfab9cc8825 req-589735ef-3abd-4306-a16a-8e23ecd8e565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "963d825e-97d2-4c17-a454-bb083fc65bb4", "tag": "c2f35fc4-db07-4a6c-b3e5-7bd5aee932e9"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:28.875697 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-52972c51-3c5d-44b1-b6bb-acfab9cc8825 req-589735ef-3abd-4306-a16a-8e23ecd8e565 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:28.876468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-52972c51-3c5d-44b1-b6bb-acfab9cc8825 req-589735ef-3abd-4306-a16a-8e23ecd8e565 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:28.889269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-52972c51-3c5d-44b1-b6bb-acfab9cc8825 req-589735ef-3abd-4306-a16a-8e23ecd8e565 service nova] Creating event network-changed:c2f35fc4-db07-4a6c-b3e5-7bd5aee932e9 for instance 963d825e-97d2-4c17-a454-bb083fc65bb4 on hv-cinder-81268 Jun 30 13:08:28.894202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-52972c51-3c5d-44b1-b6bb-acfab9cc8825 req-589735ef-3abd-4306-a16a-8e23ecd8e565 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044915 Jun 30 13:08:28.894858 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 129/263] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:08:29.310023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-365848cc-0d2a-42ba-b63d-c25f121a795d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:29.310635 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-365848cc-0d2a-42ba-b63d-c25f121a795d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:29.317352 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-365848cc-0d2a-42ba-b63d-c25f121a795d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:29.317794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-365848cc-0d2a-42ba-b63d-c25f121a795d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:29.318587 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-365848cc-0d2a-42ba-b63d-c25f121a795d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:29.319011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-365848cc-0d2a-42ba-b63d-c25f121a795d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:29.450796 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-365848cc-0d2a-42ba-b63d-c25f121a795d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:29.459322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-365848cc-0d2a-42ba-b63d-c25f121a795d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.153263 Jun 30 13:08:29.459972 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 135/264] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:29 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:29.590157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ef8eedab-adfb-4527-977c-f70664834e05 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:29.591211 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ef8eedab-adfb-4527-977c-f70664834e05 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:29.597938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ef8eedab-adfb-4527-977c-f70664834e05 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:29.598379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ef8eedab-adfb-4527-977c-f70664834e05 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:29.599148 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ef8eedab-adfb-4527-977c-f70664834e05 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:29.599572 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ef8eedab-adfb-4527-977c-f70664834e05 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:29.746255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ef8eedab-adfb-4527-977c-f70664834e05 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:29.755337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ef8eedab-adfb-4527-977c-f70664834e05 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.169868 Jun 30 13:08:29.755941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 130/265] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:29 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:30.481234 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-74f4a8a6-1e7a-454f-974e-f3faeb4f72b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:30.482156 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-74f4a8a6-1e7a-454f-974e-f3faeb4f72b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:30.492442 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74f4a8a6-1e7a-454f-974e-f3faeb4f72b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:30.493168 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74f4a8a6-1e7a-454f-974e-f3faeb4f72b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:30.494428 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74f4a8a6-1e7a-454f-974e-f3faeb4f72b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:30.495177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74f4a8a6-1e7a-454f-974e-f3faeb4f72b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:30.637126 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74f4a8a6-1e7a-454f-974e-f3faeb4f72b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:30.645276 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-74f4a8a6-1e7a-454f-974e-f3faeb4f72b4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.170565 Jun 30 13:08:30.645808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 136/266] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:30 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:30.772659 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2f51152b-9738-41f2-88ee-78a10cb06a37 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:30.773287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2f51152b-9738-41f2-88ee-78a10cb06a37 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:30.780219 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f51152b-9738-41f2-88ee-78a10cb06a37 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:30.780649 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f51152b-9738-41f2-88ee-78a10cb06a37 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:30.781399 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f51152b-9738-41f2-88ee-78a10cb06a37 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:30.781815 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f51152b-9738-41f2-88ee-78a10cb06a37 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:30.922286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2f51152b-9738-41f2-88ee-78a10cb06a37 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:30.929849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2f51152b-9738-41f2-88ee-78a10cb06a37 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.161115 Jun 30 13:08:30.930534 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 131/267] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:30 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:31.666656 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8be3164-0cf1-450f-ac61-8e49432b8dbe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:31.667701 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c8be3164-0cf1-450f-ac61-8e49432b8dbe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:31.677444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8be3164-0cf1-450f-ac61-8e49432b8dbe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:31.677887 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8be3164-0cf1-450f-ac61-8e49432b8dbe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:31.678674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8be3164-0cf1-450f-ac61-8e49432b8dbe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:31.679095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8be3164-0cf1-450f-ac61-8e49432b8dbe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:31.821978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8be3164-0cf1-450f-ac61-8e49432b8dbe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:31.829607 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c8be3164-0cf1-450f-ac61-8e49432b8dbe tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.169585 Jun 30 13:08:31.830148 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 137/268] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:31 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:31.946950 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f9756fef-8432-4257-bf21-7335b8ce2cb4 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:31.947551 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f9756fef-8432-4257-bf21-7335b8ce2cb4 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:31.954410 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f9756fef-8432-4257-bf21-7335b8ce2cb4 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:31.954858 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f9756fef-8432-4257-bf21-7335b8ce2cb4 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:31.955609 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f9756fef-8432-4257-bf21-7335b8ce2cb4 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:31.956028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f9756fef-8432-4257-bf21-7335b8ce2cb4 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:32.093976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f9756fef-8432-4257-bf21-7335b8ce2cb4 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:32.102133 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f9756fef-8432-4257-bf21-7335b8ce2cb4 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.159016 Jun 30 13:08:32.102712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 132/269] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:31 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:32.847487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2976492-6fae-4498-9944-028f2f5f08cb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:32.848087 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2976492-6fae-4498-9944-028f2f5f08cb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:32.854886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2976492-6fae-4498-9944-028f2f5f08cb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:32.855316 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2976492-6fae-4498-9944-028f2f5f08cb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:32.856062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2976492-6fae-4498-9944-028f2f5f08cb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:32.856460 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2976492-6fae-4498-9944-028f2f5f08cb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:32.893141 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:32.996043 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2976492-6fae-4498-9944-028f2f5f08cb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:33.008720 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2976492-6fae-4498-9944-028f2f5f08cb tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.164907 Jun 30 13:08:33.009480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 138/270] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:32 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:33.118880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d153b3a6-473d-4e6d-8ecc-7f8275dbbac7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:33.119452 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d153b3a6-473d-4e6d-8ecc-7f8275dbbac7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:33.121491 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:33.122350 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=6 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:33.128702 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d153b3a6-473d-4e6d-8ecc-7f8275dbbac7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:33.129127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d153b3a6-473d-4e6d-8ecc-7f8275dbbac7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:33.129886 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d153b3a6-473d-4e6d-8ecc-7f8275dbbac7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:33.130360 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d153b3a6-473d-4e6d-8ecc-7f8275dbbac7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:33.269207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d153b3a6-473d-4e6d-8ecc-7f8275dbbac7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:33.276975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d153b3a6-473d-4e6d-8ecc-7f8275dbbac7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.162016 Jun 30 13:08:33.277543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 133/271] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:33 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:34.026648 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-525ea8da-0df9-478a-a7c7-c82524612e8c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:34.027251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-525ea8da-0df9-478a-a7c7-c82524612e8c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:34.033633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-525ea8da-0df9-478a-a7c7-c82524612e8c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:34.034080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-525ea8da-0df9-478a-a7c7-c82524612e8c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:34.034872 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-525ea8da-0df9-478a-a7c7-c82524612e8c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:34.035300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-525ea8da-0df9-478a-a7c7-c82524612e8c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:34.173458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-525ea8da-0df9-478a-a7c7-c82524612e8c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:34.181220 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-525ea8da-0df9-478a-a7c7-c82524612e8c tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.158561 Jun 30 13:08:34.181791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 139/272] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:34 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:34.293311 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-59d92c7e-a7da-4115-87c6-91a4a09b63ad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:34.293979 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-59d92c7e-a7da-4115-87c6-91a4a09b63ad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:34.300729 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59d92c7e-a7da-4115-87c6-91a4a09b63ad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:34.301239 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59d92c7e-a7da-4115-87c6-91a4a09b63ad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:34.302047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59d92c7e-a7da-4115-87c6-91a4a09b63ad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:34.302554 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59d92c7e-a7da-4115-87c6-91a4a09b63ad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:34.441873 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-59d92c7e-a7da-4115-87c6-91a4a09b63ad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:34.450694 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-59d92c7e-a7da-4115-87c6-91a4a09b63ad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.161064 Jun 30 13:08:34.461086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 134/273] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:34 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:08:35.198190 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1eb1b12c-7c52-41dd-a8ba-d85e7d034964 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:35.199830 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1eb1b12c-7c52-41dd-a8ba-d85e7d034964 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:35.206894 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1eb1b12c-7c52-41dd-a8ba-d85e7d034964 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:35.207682 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1eb1b12c-7c52-41dd-a8ba-d85e7d034964 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:35.208598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1eb1b12c-7c52-41dd-a8ba-d85e7d034964 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:35.209256 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1eb1b12c-7c52-41dd-a8ba-d85e7d034964 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:35.383026 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1eb1b12c-7c52-41dd-a8ba-d85e7d034964 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:35.390636 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1eb1b12c-7c52-41dd-a8ba-d85e7d034964 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.196520 Jun 30 13:08:35.391414 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 140/274] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:35 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:35.468207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cb48f814-fcfc-4ff2-b618-b1a30a7adca0 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:35.469415 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cb48f814-fcfc-4ff2-b618-b1a30a7adca0 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:35.476722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb48f814-fcfc-4ff2-b618-b1a30a7adca0 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:35.477333 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb48f814-fcfc-4ff2-b618-b1a30a7adca0 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:35.478245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb48f814-fcfc-4ff2-b618-b1a30a7adca0 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:35.478854 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb48f814-fcfc-4ff2-b618-b1a30a7adca0 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:35.614241 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cb48f814-fcfc-4ff2-b618-b1a30a7adca0 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:35.622299 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cb48f814-fcfc-4ff2-b618-b1a30a7adca0 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.158291 Jun 30 13:08:35.622978 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 135/275] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:35 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:36.409729 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-42767f0b-139a-461c-af66-b7c9454d2f1a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:36.410487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-42767f0b-139a-461c-af66-b7c9454d2f1a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:36.417153 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42767f0b-139a-461c-af66-b7c9454d2f1a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:36.417688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42767f0b-139a-461c-af66-b7c9454d2f1a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:36.418633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42767f0b-139a-461c-af66-b7c9454d2f1a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:36.419227 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-42767f0b-139a-461c-af66-b7c9454d2f1a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:36.558852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-42767f0b-139a-461c-af66-b7c9454d2f1a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:36.568098 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-42767f0b-139a-461c-af66-b7c9454d2f1a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.162862 Jun 30 13:08:36.578343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 141/276] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:36 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:36.605905 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-863b6737-3728-4c63-bd5e-a677c0bfb366 req-26dee630-79b7-4a1c-8620-b006053227dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "963d825e-97d2-4c17-a454-bb083fc65bb4", "name": "network-vif-plugged", "status": "completed", "tag": "c2f35fc4-db07-4a6c-b3e5-7bd5aee932e9"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:36.615727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-863b6737-3728-4c63-bd5e-a677c0bfb366 req-26dee630-79b7-4a1c-8620-b006053227dd service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:36.616532 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-863b6737-3728-4c63-bd5e-a677c0bfb366 req-26dee630-79b7-4a1c-8620-b006053227dd service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:36.633207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-863b6737-3728-4c63-bd5e-a677c0bfb366 req-26dee630-79b7-4a1c-8620-b006053227dd service nova] Creating event network-vif-plugged:c2f35fc4-db07-4a6c-b3e5-7bd5aee932e9 for instance 963d825e-97d2-4c17-a454-bb083fc65bb4 on hv-cinder-81268 Jun 30 13:08:36.641865 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ed98a8f3-4212-46fa-bd3b-4ade99422295 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:36.642521 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ed98a8f3-4212-46fa-bd3b-4ade99422295 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:36.650133 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-863b6737-3728-4c63-bd5e-a677c0bfb366 req-26dee630-79b7-4a1c-8620-b006053227dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048885 Jun 30 13:08:36.653327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed98a8f3-4212-46fa-bd3b-4ade99422295 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:36.653792 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed98a8f3-4212-46fa-bd3b-4ade99422295 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:36.654067 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 136/277] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:08:36.655325 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed98a8f3-4212-46fa-bd3b-4ade99422295 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:36.655745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed98a8f3-4212-46fa-bd3b-4ade99422295 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:36.967677 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ed98a8f3-4212-46fa-bd3b-4ade99422295 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:36.975788 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ed98a8f3-4212-46fa-bd3b-4ade99422295 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.338691 Jun 30 13:08:36.976360 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 142/278] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:36 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:37.585617 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-490562a3-39b1-4073-8ec3-4f39c3b67685 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:37.586213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-490562a3-39b1-4073-8ec3-4f39c3b67685 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:37.593858 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-490562a3-39b1-4073-8ec3-4f39c3b67685 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:37.594550 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-490562a3-39b1-4073-8ec3-4f39c3b67685 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:37.595545 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-490562a3-39b1-4073-8ec3-4f39c3b67685 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:37.595967 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-490562a3-39b1-4073-8ec3-4f39c3b67685 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:37.737383 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-490562a3-39b1-4073-8ec3-4f39c3b67685 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:37.746293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-490562a3-39b1-4073-8ec3-4f39c3b67685 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.164864 Jun 30 13:08:37.747093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 137/279] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:37 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:37.992460 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a0c93dfe-83ae-4cb7-abba-5df8d36772e3 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:37.993781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a0c93dfe-83ae-4cb7-abba-5df8d36772e3 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:38.000805 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c93dfe-83ae-4cb7-abba-5df8d36772e3 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:38.001237 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c93dfe-83ae-4cb7-abba-5df8d36772e3 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:38.001995 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c93dfe-83ae-4cb7-abba-5df8d36772e3 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:38.002436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a0c93dfe-83ae-4cb7-abba-5df8d36772e3 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:38.270275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a0c93dfe-83ae-4cb7-abba-5df8d36772e3 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:38.278802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a0c93dfe-83ae-4cb7-abba-5df8d36772e3 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1318 microversion: 2.1 time: 0.290152 Jun 30 13:08:38.279778 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 143/280] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:37 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:38.766073 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-173e2ad4-ff55-4690-957a-d66c21459c2a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:38.766913 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-173e2ad4-ff55-4690-957a-d66c21459c2a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:38.773859 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-173e2ad4-ff55-4690-957a-d66c21459c2a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:38.774810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-173e2ad4-ff55-4690-957a-d66c21459c2a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:38.775855 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-173e2ad4-ff55-4690-957a-d66c21459c2a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:38.776496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-173e2ad4-ff55-4690-957a-d66c21459c2a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:38.986690 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-173e2ad4-ff55-4690-957a-d66c21459c2a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:38.994771 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-173e2ad4-ff55-4690-957a-d66c21459c2a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.233985 Jun 30 13:08:38.995340 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 138/281] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:38 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:39.295340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c63734d4-d3fb-4c77-bcd6-b871fb80b3be tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:39.295903 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c63734d4-d3fb-4c77-bcd6-b871fb80b3be tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:39.302295 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c63734d4-d3fb-4c77-bcd6-b871fb80b3be tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:39.302989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c63734d4-d3fb-4c77-bcd6-b871fb80b3be tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:39.303772 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c63734d4-d3fb-4c77-bcd6-b871fb80b3be tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:39.304260 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c63734d4-d3fb-4c77-bcd6-b871fb80b3be tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:39.460533 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c63734d4-d3fb-4c77-bcd6-b871fb80b3be tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:39.462984 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:39.470444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c63734d4-d3fb-4c77-bcd6-b871fb80b3be tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1507 microversion: 2.1 time: 0.178921 Jun 30 13:08:39.471610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 144/282] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:39 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:40.015712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ecb9baac-8a63-4d01-ae98-35fc9a19e7f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:40.017358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ecb9baac-8a63-4d01-ae98-35fc9a19e7f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:40.033289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecb9baac-8a63-4d01-ae98-35fc9a19e7f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:40.033840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecb9baac-8a63-4d01-ae98-35fc9a19e7f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:40.035535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecb9baac-8a63-4d01-ae98-35fc9a19e7f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:40.036043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecb9baac-8a63-4d01-ae98-35fc9a19e7f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:40.292558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ecb9baac-8a63-4d01-ae98-35fc9a19e7f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:40.300908 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ecb9baac-8a63-4d01-ae98-35fc9a19e7f3 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.292735 Jun 30 13:08:40.301459 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 139/283] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:40 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:41.318969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-187134c6-de94-4ce1-8478-d59ab7266318 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:41.319651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-187134c6-de94-4ce1-8478-d59ab7266318 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:41.327906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-187134c6-de94-4ce1-8478-d59ab7266318 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:41.328264 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-187134c6-de94-4ce1-8478-d59ab7266318 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:41.329101 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-187134c6-de94-4ce1-8478-d59ab7266318 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:41.329578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-187134c6-de94-4ce1-8478-d59ab7266318 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:41.480455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-187134c6-de94-4ce1-8478-d59ab7266318 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:41.488341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-187134c6-de94-4ce1-8478-d59ab7266318 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.173614 Jun 30 13:08:41.498449 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 145/284] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:41 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:42.507091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-80530b59-9a36-447c-a52a-9516f1c427cd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:42.508846 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-80530b59-9a36-447c-a52a-9516f1c427cd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:42.518706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-80530b59-9a36-447c-a52a-9516f1c427cd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:42.520213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-80530b59-9a36-447c-a52a-9516f1c427cd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:42.521335 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-80530b59-9a36-447c-a52a-9516f1c427cd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:42.521939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-80530b59-9a36-447c-a52a-9516f1c427cd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:42.778977 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-80530b59-9a36-447c-a52a-9516f1c427cd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:42.793934 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-80530b59-9a36-447c-a52a-9516f1c427cd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.292534 Jun 30 13:08:42.795563 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 140/285] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:42 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:43.812413 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-63d44a1f-6f6d-418e-a139-29b04525acbd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:43.813733 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-63d44a1f-6f6d-418e-a139-29b04525acbd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:43.823570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63d44a1f-6f6d-418e-a139-29b04525acbd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:43.824285 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63d44a1f-6f6d-418e-a139-29b04525acbd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:43.825485 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63d44a1f-6f6d-418e-a139-29b04525acbd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:43.826139 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63d44a1f-6f6d-418e-a139-29b04525acbd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:44.342725 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63d44a1f-6f6d-418e-a139-29b04525acbd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:44.379408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-63d44a1f-6f6d-418e-a139-29b04525acbd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1501 microversion: 2.1 time: 0.569970 Jun 30 13:08:44.380627 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 146/286] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:43 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1501 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:44.400862 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a96aa64-3e8b-45e0-b039-9d8c1317fafa"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:44.402758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:44.418235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:44.418826 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:44.419688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:44.420125 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:44.489528 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] HTTP exception thrown: Cannot 'attach_volume' instance 227d6c05-e0fc-477e-a03e-cf5160212c76 while it is in vm_state rescued Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Request method failure captured: Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: POST /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76/os-volume_attachments HTTP/1.1 Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 74 Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivaAIiDqmzBk003FXqe908sKplnTOTTe0uls5Nb8W8-zMdKmCsB-qpzXIvF9yYVYkb9yALsgVIgttIi01Upr8CXOW-00eiFTlAUMZr93waJwCoH1jb-eeAiJZG7ktMvlqrdytI7P28ZHMQbEezLOmyoqkbkEskw-g3MbLo0VWlZFO-ZE Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:08:44.491451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_792f217e834c4049b5b0d856cd53f947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}] Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: a7ce962e4a7447848e3454905102d27c Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {"volumeAttachment": {"volumeId": "3a96aa64-3e8b-45e0-b039-9d8c1317fafa"}} Jun 30 13:08:44.492710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Cannot 'attach_volume' instance 227d6c05-e0fc-477e-a03e-cf5160212c76 while it is in vm_state rescued Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'server_id': '227d6c05-e0fc-477e-a03e-cf5160212c76', 'body': {'volumeAttachment': {'volumeId': '3a96aa64-3e8b-45e0-b039-9d8c1317fafa'}}} Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 227d6c05-e0fc-477e-a03e-cf5160212c76 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:08:44.493456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 227d6c05-e0fc-477e-a03e-cf5160212c76 while it is in vm_state rescued Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:08:44.494982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:08:44.496711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:08:44.496711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:08:44.496711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 227d6c05-e0fc-477e-a03e-cf5160212c76 while it is in vm_state rescued Jun 30 13:08:44.496711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:08:44.496711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Returning 409 to user: Cannot 'attach_volume' instance 227d6c05-e0fc-477e-a03e-cf5160212c76 while it is in vm_state rescued {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:08:44.496711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5db6cf81-4d4f-47de-b5fd-e557527fbb3d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.097038 Jun 30 13:08:44.496711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 141/287] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:08:44 2022] POST /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76/os-volume_attachments => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 13:08:44.504395 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8e518eb3-31bf-4d1e-8bc8-87f37d8f6fac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:44.505308 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8e518eb3-31bf-4d1e-8bc8-87f37d8f6fac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:44.512801 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e518eb3-31bf-4d1e-8bc8-87f37d8f6fac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:44.513617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e518eb3-31bf-4d1e-8bc8-87f37d8f6fac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:44.515056 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e518eb3-31bf-4d1e-8bc8-87f37d8f6fac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:44.515700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e518eb3-31bf-4d1e-8bc8-87f37d8f6fac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:44.626509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8e518eb3-31bf-4d1e-8bc8-87f37d8f6fac tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76/action" status: 202 len: 0 microversion: 2.1 time: 0.126724 Jun 30 13:08:44.629225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 147/288] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:08:44 2022] POST /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:08:44.638186 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-31266423-5e31-49c8-9348-08c25f72e5ef tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:44.639223 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-31266423-5e31-49c8-9348-08c25f72e5ef tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:44.645736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-31266423-5e31-49c8-9348-08c25f72e5ef tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:44.646605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-31266423-5e31-49c8-9348-08c25f72e5ef tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:44.647739 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-31266423-5e31-49c8-9348-08c25f72e5ef tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:44.648437 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-31266423-5e31-49c8-9348-08c25f72e5ef tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:44.653630 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:44.913436 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-31266423-5e31-49c8-9348-08c25f72e5ef tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:44.925081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-31266423-5e31-49c8-9348-08c25f72e5ef tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1509 microversion: 2.1 time: 0.290877 Jun 30 13:08:44.944806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 142/289] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:44 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:45.945936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c9310eea-e130-4af0-8286-0800780d0da9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:45.947489 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c9310eea-e130-4af0-8286-0800780d0da9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:45.955497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9310eea-e130-4af0-8286-0800780d0da9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:45.956880 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9310eea-e130-4af0-8286-0800780d0da9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:45.957682 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9310eea-e130-4af0-8286-0800780d0da9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:45.958312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9310eea-e130-4af0-8286-0800780d0da9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:46.104933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c9310eea-e130-4af0-8286-0800780d0da9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:46.112597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c9310eea-e130-4af0-8286-0800780d0da9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1509 microversion: 2.1 time: 0.171604 Jun 30 13:08:46.113363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 148/290] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:45 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:46.268698 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f39fb136-403b-46a0-9a73-cb193c8be33a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Action: 'create', calling method: .version_select at 0x7f4ba427e670>, body: {"keypair": {"name": "tempest-TestShelveInstance-11899063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1X1m2jAVJTVg+q9sREQ6JVIKCx6FX2TbrNY0IUY6TButpyI7OPG+vL4JKYC6IxL2bLsyDMSq6ft/AHBQpRfS6n7gD97sgrS/qHVCVNV9kKlxhty0iVLR2r/rbtzrexLg=="}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:46.283439 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-f39fb136-403b-46a0-9a73-cb193c8be33a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Getting quotas for project 19004d450eee426786ca037d00f8fff4. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:08:46.287667 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-f39fb136-403b-46a0-9a73-cb193c8be33a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Getting quotas for user 9e51be11f09d44588e5b4ef657907fe6 and project 19004d450eee426786ca037d00f8fff4. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:08:46.314700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f39fb136-403b-46a0-9a73-cb193c8be33a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.289449 Jun 30 13:08:46.315293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 143/291] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:08:46 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:08:47.129972 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09a45c97-2e9f-46b2-b91f-b14433d9bb0b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:47.130775 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09a45c97-2e9f-46b2-b91f-b14433d9bb0b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:47.137298 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a45c97-2e9f-46b2-b91f-b14433d9bb0b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:47.137723 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a45c97-2e9f-46b2-b91f-b14433d9bb0b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:47.138520 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a45c97-2e9f-46b2-b91f-b14433d9bb0b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:47.138938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09a45c97-2e9f-46b2-b91f-b14433d9bb0b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:47.343018 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09a45c97-2e9f-46b2-b91f-b14433d9bb0b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:47.350806 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09a45c97-2e9f-46b2-b91f-b14433d9bb0b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1509 microversion: 2.1 time: 0.224608 Jun 30 13:08:47.351388 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 149/292] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:47 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:48.368651 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bfc14a3d-260f-49a7-996e-79778ddf705e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:48.369660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bfc14a3d-260f-49a7-996e-79778ddf705e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:48.392580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bfc14a3d-260f-49a7-996e-79778ddf705e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:48.393299 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bfc14a3d-260f-49a7-996e-79778ddf705e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:48.394415 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bfc14a3d-260f-49a7-996e-79778ddf705e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:48.394843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bfc14a3d-260f-49a7-996e-79778ddf705e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:48.622974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bfc14a3d-260f-49a7-996e-79778ddf705e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:48.636711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bfc14a3d-260f-49a7-996e-79778ddf705e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1509 microversion: 2.1 time: 0.272099 Jun 30 13:08:48.646260 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 144/293] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:48 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:49.653219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-135a45e3-f76d-4ac0-a54b-923b44c792c8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:49.654440 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-135a45e3-f76d-4ac0-a54b-923b44c792c8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:49.661104 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-135a45e3-f76d-4ac0-a54b-923b44c792c8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:49.661840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-135a45e3-f76d-4ac0-a54b-923b44c792c8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:49.662853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-135a45e3-f76d-4ac0-a54b-923b44c792c8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:49.663447 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-135a45e3-f76d-4ac0-a54b-923b44c792c8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:49.814779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-135a45e3-f76d-4ac0-a54b-923b44c792c8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:49.824792 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-135a45e3-f76d-4ac0-a54b-923b44c792c8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1515 microversion: 2.1 time: 0.175291 Jun 30 13:08:49.825710 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 150/294] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:49 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:51.244991 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7fccdab9-e76e-419e-94d1-22bea492da4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'create', calling method: .version_select at 0x7f4ba42f9430>, body: {"keypair": {"name": "tempest-keypair-262057944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8oKZ+83E7z/JhKpGPr6vgnRfLj/t5QsrLyFFZYV43d9qMO5Y8lUe8jNzabSl6kGyM8ba3tPEANPSPfIJqAo3aHOtCRCkZNPR+g9mz1SU9XASJjQoIZHSJ4yYlxBAVVBQ=="}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:51.260410 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-7fccdab9-e76e-419e-94d1-22bea492da4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Getting quotas for project 792f217e834c4049b5b0d856cd53f947. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:08:51.264418 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-7fccdab9-e76e-419e-94d1-22bea492da4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Getting quotas for user a7ce962e4a7447848e3454905102d27c and project 792f217e834c4049b5b0d856cd53f947. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:08:51.292013 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7fccdab9-e76e-419e-94d1-22bea492da4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051958 Jun 30 13:08:51.292604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 145/295] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:08:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:08:52.675890 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-680101677", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "120ca554-5550-41aa-ba84-8c9f590c4e34"}], "security_groups": [{"name": "tempest-securitygroup--31445338"}], "key_name": "tempest-keypair-262057944", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:54.197728 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] validate_networks() for [('120ca554-5550-41aa-ba84-8c9f590c4e34', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:08:54.384881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=44 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:54.595554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:08:54.595953 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:08:54.596409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:08:54.596804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:08:54.597197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:08:54.606763 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:54.607194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:54.607968 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:54.608384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:54.625932 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Getting quotas for project 792f217e834c4049b5b0d856cd53f947. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:08:54.630344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Getting quotas for user a7ce962e4a7447848e3454905102d27c and project 792f217e834c4049b5b0d856cd53f947. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:08:54.642777 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:08:54.644937 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:08:54.699568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9926f925-e7ed-4a6b-bf02-29844eab5b18 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.028021 Jun 30 13:08:54.700561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 151/296] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:08:52 2022] POST /compute/v2.1/servers => generated 407 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:08:54.711690 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3f919911-dd83-43f4-a42b-4c165011dbce tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:54.712292 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3f919911-dd83-43f4-a42b-4c165011dbce tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:54.714154 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:54.768011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3f919911-dd83-43f4-a42b-4c165011dbce tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:54.775801 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3f919911-dd83-43f4-a42b-4c165011dbce tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1244 microversion: 2.1 time: 0.068765 Jun 30 13:08:54.776422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 146/297] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:54 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:55.793513 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f35c0f9b-d9a0-452a-a407-464dbb112eed tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:55.794309 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f35c0f9b-d9a0-452a-a407-464dbb112eed tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:55.801448 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f35c0f9b-d9a0-452a-a407-464dbb112eed tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:55.801814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f35c0f9b-d9a0-452a-a407-464dbb112eed tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:55.802621 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f35c0f9b-d9a0-452a-a407-464dbb112eed tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:55.803043 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f35c0f9b-d9a0-452a-a407-464dbb112eed tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:55.874828 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f35c0f9b-d9a0-452a-a407-464dbb112eed tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:55.887745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f35c0f9b-d9a0-452a-a407-464dbb112eed tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1296 microversion: 2.1 time: 0.098027 Jun 30 13:08:55.888549 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 152/298] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:55 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:56.609880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-30c8b786-2119-4262-984d-9efa73e24a84 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:56.610447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-30c8b786-2119-4262-984d-9efa73e24a84 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:56.617325 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-30c8b786-2119-4262-984d-9efa73e24a84 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:56.617760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-30c8b786-2119-4262-984d-9efa73e24a84 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:56.618579 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-30c8b786-2119-4262-984d-9efa73e24a84 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:56.618997 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-30c8b786-2119-4262-984d-9efa73e24a84 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:56.642764 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-30c8b786-2119-4262-984d-9efa73e24a84 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/ips" status: 200 len: 151 microversion: 2.20 time: 0.038302 Jun 30 13:08:56.643321 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 147/299] 10.222.0.49 () {60 vars in 1288 bytes} [Thu Jun 30 13:08:56 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 13:08:56.912173 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-91d1946d-2c98-46bf-ba03-4f89ecd967b1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:56.915495 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-91d1946d-2c98-46bf-ba03-4f89ecd967b1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:56.928606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91d1946d-2c98-46bf-ba03-4f89ecd967b1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:56.929047 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91d1946d-2c98-46bf-ba03-4f89ecd967b1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:56.929808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91d1946d-2c98-46bf-ba03-4f89ecd967b1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:56.930224 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91d1946d-2c98-46bf-ba03-4f89ecd967b1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:57.019105 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-91d1946d-2c98-46bf-ba03-4f89ecd967b1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:57.034971 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-91d1946d-2c98-46bf-ba03-4f89ecd967b1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1302 microversion: 2.1 time: 0.133377 Jun 30 13:08:57.035996 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 153/300] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:56 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1302 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:58.052180 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d0ec06b4-de7f-424c-8160-d7c019231db2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:58.052883 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d0ec06b4-de7f-424c-8160-d7c019231db2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:58.059918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d0ec06b4-de7f-424c-8160-d7c019231db2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:58.060573 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d0ec06b4-de7f-424c-8160-d7c019231db2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:58.061709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d0ec06b4-de7f-424c-8160-d7c019231db2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:58.062246 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d0ec06b4-de7f-424c-8160-d7c019231db2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:58.089731 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-83379abc-996a-44f5-a296-0dfac222ca8d req-e4799f84-fafd-4aa2-99d1-9f9d5e691db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d58b08a-c2ee-4f45-90c0-400b9e677939", "tag": "f167dfd2-b19b-402d-b775-ccdceb0797f3"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:08:58.113465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-83379abc-996a-44f5-a296-0dfac222ca8d req-e4799f84-fafd-4aa2-99d1-9f9d5e691db3 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:58.114127 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-83379abc-996a-44f5-a296-0dfac222ca8d req-e4799f84-fafd-4aa2-99d1-9f9d5e691db3 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:58.127127 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-83379abc-996a-44f5-a296-0dfac222ca8d req-e4799f84-fafd-4aa2-99d1-9f9d5e691db3 service nova] Creating event network-changed:f167dfd2-b19b-402d-b775-ccdceb0797f3 for instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 on hv-cinder-81268 Jun 30 13:08:58.132085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-83379abc-996a-44f5-a296-0dfac222ca8d req-e4799f84-fafd-4aa2-99d1-9f9d5e691db3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046079 Jun 30 13:08:58.132692 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 154/301] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:08:58.282962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d0ec06b4-de7f-424c-8160-d7c019231db2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:58.290360 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d0ec06b4-de7f-424c-8160-d7c019231db2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.242243 Jun 30 13:08:58.290917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 148/302] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:58 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:08:59.308351 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-53e9f70a-0b27-4912-a4bd-fb0779acf5c0 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:08:59.308974 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-53e9f70a-0b27-4912-a4bd-fb0779acf5c0 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:08:59.315865 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e9f70a-0b27-4912-a4bd-fb0779acf5c0 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:59.316306 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e9f70a-0b27-4912-a4bd-fb0779acf5c0 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:59.317058 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e9f70a-0b27-4912-a4bd-fb0779acf5c0 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:08:59.317480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-53e9f70a-0b27-4912-a4bd-fb0779acf5c0 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:08:59.455114 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-53e9f70a-0b27-4912-a4bd-fb0779acf5c0 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:08:59.463212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-53e9f70a-0b27-4912-a4bd-fb0779acf5c0 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.159091 Jun 30 13:08:59.463799 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 155/303] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:08:59 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:00.167603 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5f342cb2-9848-4b04-8227-48f7b02d67c5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:00.168228 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5f342cb2-9848-4b04-8227-48f7b02d67c5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:00.175891 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5f342cb2-9848-4b04-8227-48f7b02d67c5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:00.176330 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5f342cb2-9848-4b04-8227-48f7b02d67c5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:00.177086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5f342cb2-9848-4b04-8227-48f7b02d67c5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:00.177500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5f342cb2-9848-4b04-8227-48f7b02d67c5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:00.202282 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-5f342cb2-9848-4b04-8227-48f7b02d67c5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lazy-loading 'flavor' on Instance uuid 7f2c8af5-6d65-4177-9434-65a1d15813c9 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:09:00.480997 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d23d9528-1991-4860-92c3-6d7b1f0cd024 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:00.481722 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d23d9528-1991-4860-92c3-6d7b1f0cd024 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:00.489194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d23d9528-1991-4860-92c3-6d7b1f0cd024 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:00.489666 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d23d9528-1991-4860-92c3-6d7b1f0cd024 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:00.490434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d23d9528-1991-4860-92c3-6d7b1f0cd024 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:00.490852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d23d9528-1991-4860-92c3-6d7b1f0cd024 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:00.510160 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5f342cb2-9848-4b04-8227-48f7b02d67c5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/action" status: 202 len: 0 microversion: 2.20 time: 0.348876 Jun 30 13:09:00.510883 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 149/304] 10.222.0.49 () {62 vars in 1318 bytes} [Thu Jun 30 13:09:00 2022] POST /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:09:00.520002 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:00.520584 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:00.527233 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:00.527678 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:00.528434 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:00.528853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:00.634690 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d23d9528-1991-4860-92c3-6d7b1f0cd024 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:00.642156 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d23d9528-1991-4860-92c3-6d7b1f0cd024 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.165364 Jun 30 13:09:00.642758 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 156/305] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:00 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:00.661402 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:00.669278 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:00.670775 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:00.672115 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5a90052f-4168-471f-a835-87fade6ce476 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.156437 Jun 30 13:09:00.672629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 150/306] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:00 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:01.659315 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9aa43ef5-2441-49dd-a016-4a052e914b1e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:01.659948 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9aa43ef5-2441-49dd-a016-4a052e914b1e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:01.666447 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9aa43ef5-2441-49dd-a016-4a052e914b1e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:01.666886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9aa43ef5-2441-49dd-a016-4a052e914b1e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:01.667636 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9aa43ef5-2441-49dd-a016-4a052e914b1e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:01.668056 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9aa43ef5-2441-49dd-a016-4a052e914b1e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:01.690200 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:01.690813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:01.697582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:01.698046 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:01.698806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:01.699231 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:01.808126 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9aa43ef5-2441-49dd-a016-4a052e914b1e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:01.817004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9aa43ef5-2441-49dd-a016-4a052e914b1e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.161489 Jun 30 13:09:01.817871 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 157/307] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:01 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:01.842957 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:01.851676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:01.853220 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:01.854438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d2ff54dd-dac6-4927-91da-13b7bf920b31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.168187 Jun 30 13:09:01.854961 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 151/308] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:01 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:02.838002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a69684e6-ad1c-4121-a84e-ea29b3b37da2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:02.838988 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a69684e6-ad1c-4121-a84e-ea29b3b37da2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:02.848570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a69684e6-ad1c-4121-a84e-ea29b3b37da2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:02.849004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a69684e6-ad1c-4121-a84e-ea29b3b37da2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:02.849747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a69684e6-ad1c-4121-a84e-ea29b3b37da2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:02.850165 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a69684e6-ad1c-4121-a84e-ea29b3b37da2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:02.873316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:02.874151 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:02.881680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:02.882045 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:02.882847 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:02.883272 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:02.984804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a69684e6-ad1c-4121-a84e-ea29b3b37da2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:02.994431 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a69684e6-ad1c-4121-a84e-ea29b3b37da2 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.162879 Jun 30 13:09:02.994992 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 158/309] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:02 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:03.021036 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:03.033537 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:03.035321 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:03.036497 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7cdef84e-1f7c-4cff-b8ff-7014cce67096 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.167152 Jun 30 13:09:03.037048 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 152/310] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:02 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:04.016726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-705604fa-6052-4cc3-833d-d9633a221353 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:04.017602 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-705604fa-6052-4cc3-833d-d9633a221353 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:04.025095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-705604fa-6052-4cc3-833d-d9633a221353 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:04.025529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-705604fa-6052-4cc3-833d-d9633a221353 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:04.026273 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-705604fa-6052-4cc3-833d-d9633a221353 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:04.026727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-705604fa-6052-4cc3-833d-d9633a221353 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:04.055141 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:04.055750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:04.063426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:04.063992 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:04.064938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:04.065592 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:04.164464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-705604fa-6052-4cc3-833d-d9633a221353 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:04.172813 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-705604fa-6052-4cc3-833d-d9633a221353 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.162821 Jun 30 13:09:04.173414 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 159/311] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:04 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:04.349695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:04.357771 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:04.359311 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:04.360448 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b8b90aaf-b8ce-4de7-9a3c-afe7876abe23 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.309474 Jun 30 13:09:04.360990 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 153/312] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:04 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:05.189887 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ec9c3280-5c3c-477a-a6bd-1c160a46361f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:05.190544 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ec9c3280-5c3c-477a-a6bd-1c160a46361f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:05.192495 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:05.193292 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:05.199329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec9c3280-5c3c-477a-a6bd-1c160a46361f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:05.199763 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec9c3280-5c3c-477a-a6bd-1c160a46361f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:05.200512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec9c3280-5c3c-477a-a6bd-1c160a46361f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:05.200933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec9c3280-5c3c-477a-a6bd-1c160a46361f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:05.349069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec9c3280-5c3c-477a-a6bd-1c160a46361f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:05.361670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ec9c3280-5c3c-477a-a6bd-1c160a46361f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.175367 Jun 30 13:09:05.362442 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 160/313] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:05 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:05.378790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:05.379365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:05.381691 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=10 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:05.388156 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:05.388596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:05.389348 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:05.389772 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:05.531585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:05.540167 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:05.541672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:05.542871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b4bf094b-4257-415a-bd73-4f26da8f6825 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.168007 Jun 30 13:09:05.543436 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 154/314] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:05 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:06.382280 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1a06efd0-a871-41db-bd0b-26ef2d04d12d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:06.382916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1a06efd0-a871-41db-bd0b-26ef2d04d12d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:06.389427 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a06efd0-a871-41db-bd0b-26ef2d04d12d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:06.389861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a06efd0-a871-41db-bd0b-26ef2d04d12d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:06.390774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a06efd0-a871-41db-bd0b-26ef2d04d12d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:06.391194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1a06efd0-a871-41db-bd0b-26ef2d04d12d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:06.524399 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1a06efd0-a871-41db-bd0b-26ef2d04d12d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:06.526699 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:06.534051 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1a06efd0-a871-41db-bd0b-26ef2d04d12d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.157711 Jun 30 13:09:06.534676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 161/315] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:06 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:06.561235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:06.562042 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:06.569033 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:06.569464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:06.570218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:06.570662 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:06.704155 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:06.713114 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:06.714625 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:06.716161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f6c4dac2-bdd7-4213-aedd-f8e0fca4c5f5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.158448 Jun 30 13:09:06.716708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 155/316] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:06 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:07.072641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-814bb56c-1005-46f4-a6de-67092bf9ee13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:07.073421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-814bb56c-1005-46f4-a6de-67092bf9ee13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:07.084471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-814bb56c-1005-46f4-a6de-67092bf9ee13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:07.084930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-814bb56c-1005-46f4-a6de-67092bf9ee13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:07.085677 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-814bb56c-1005-46f4-a6de-67092bf9ee13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:07.086090 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-814bb56c-1005-46f4-a6de-67092bf9ee13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:07.111563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-814bb56c-1005-46f4-a6de-67092bf9ee13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/ips" status: 200 len: 150 microversion: 2.1 time: 0.045599 Jun 30 13:09:07.112120 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 162/317] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:09:07 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:07.536994 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-efa9cc0e-43f0-4752-a4c4-80353600500e req-ca26a01e-4740-4500-bc7b-350e65e92620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d58b08a-c2ee-4f45-90c0-400b9e677939", "name": "network-vif-plugged", "status": "completed", "tag": "f167dfd2-b19b-402d-b775-ccdceb0797f3"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:07.545591 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-efa9cc0e-43f0-4752-a4c4-80353600500e req-ca26a01e-4740-4500-bc7b-350e65e92620 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:07.546047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-efa9cc0e-43f0-4752-a4c4-80353600500e req-ca26a01e-4740-4500-bc7b-350e65e92620 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:07.551749 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1867ced5-4401-46cd-a061-3cc75b68b8d8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:07.553516 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1867ced5-4401-46cd-a061-3cc75b68b8d8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:07.558825 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-efa9cc0e-43f0-4752-a4c4-80353600500e req-ca26a01e-4740-4500-bc7b-350e65e92620 service nova] Creating event network-vif-plugged:f167dfd2-b19b-402d-b775-ccdceb0797f3 for instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 on hv-cinder-81268 Jun 30 13:09:07.559878 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1867ced5-4401-46cd-a061-3cc75b68b8d8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:07.560406 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1867ced5-4401-46cd-a061-3cc75b68b8d8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:07.561389 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1867ced5-4401-46cd-a061-3cc75b68b8d8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:07.562005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1867ced5-4401-46cd-a061-3cc75b68b8d8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:07.564152 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-efa9cc0e-43f0-4752-a4c4-80353600500e req-ca26a01e-4740-4500-bc7b-350e65e92620 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030885 Jun 30 13:09:07.564992 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 156/318] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:07.700725 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1867ced5-4401-46cd-a061-3cc75b68b8d8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:07.708253 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1867ced5-4401-46cd-a061-3cc75b68b8d8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.160522 Jun 30 13:09:07.708873 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 163/319] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:07 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:07.734886 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:07.735563 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:07.742027 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:07.742496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:07.743248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:07.743660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:07.922303 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:07.931656 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:07.933155 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:07.934343 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d44318db-348e-43b0-93bb-1d7f9e3d01c3 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.204207 Jun 30 13:09:07.934891 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 157/320] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:07 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:08.726690 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b08a22ed-56d5-4667-80c8-57e8aab1ac16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:08.727205 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b08a22ed-56d5-4667-80c8-57e8aab1ac16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:08.733593 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b08a22ed-56d5-4667-80c8-57e8aab1ac16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:08.734032 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b08a22ed-56d5-4667-80c8-57e8aab1ac16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:08.734820 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b08a22ed-56d5-4667-80c8-57e8aab1ac16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:08.735241 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b08a22ed-56d5-4667-80c8-57e8aab1ac16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:08.788835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-67a22693-3540-492f-806b-f35c77d52b51 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:08.789469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-67a22693-3540-492f-806b-f35c77d52b51 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:08.796360 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67a22693-3540-492f-806b-f35c77d52b51 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:08.796920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67a22693-3540-492f-806b-f35c77d52b51 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:08.797716 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67a22693-3540-492f-806b-f35c77d52b51 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:08.798137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67a22693-3540-492f-806b-f35c77d52b51 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:08.822500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-67a22693-3540-492f-806b-f35c77d52b51 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/ips" status: 200 len: 146 microversion: 2.1 time: 0.038072 Jun 30 13:09:08.823285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 158/321] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:09:08 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:08.867698 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b08a22ed-56d5-4667-80c8-57e8aab1ac16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:08.875357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b08a22ed-56d5-4667-80c8-57e8aab1ac16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.152782 Jun 30 13:09:08.875921 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 164/322] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:08 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:08.957058 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:08.958027 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:08.965279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:08.966089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:08.966881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:08.967309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:09.103852 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:09.112151 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:09.113630 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:09.114802 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c2ac6531-4691-4753-a02d-055d0f28d50a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.164324 Jun 30 13:09:09.115359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 159/323] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:08 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:09.555359 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e5baf5f8-ac0d-41d9-888c-4208ebd15220 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1097e130-581f-4a40-a8e5-90dc1e3a2728"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:09.556431 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e5baf5f8-ac0d-41d9-888c-4208ebd15220 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:09.562766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5baf5f8-ac0d-41d9-888c-4208ebd15220 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:09.563233 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5baf5f8-ac0d-41d9-888c-4208ebd15220 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:09.563976 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5baf5f8-ac0d-41d9-888c-4208ebd15220 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:09.564405 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5baf5f8-ac0d-41d9-888c-4208ebd15220 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:09.892391 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-87249231-bb10-4517-8ff5-4cf1a3c496cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:09.893359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-87249231-bb10-4517-8ff5-4cf1a3c496cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:09.901409 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-87249231-bb10-4517-8ff5-4cf1a3c496cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:09.902100 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-87249231-bb10-4517-8ff5-4cf1a3c496cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:09.903178 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-87249231-bb10-4517-8ff5-4cf1a3c496cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:09.903654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-87249231-bb10-4517-8ff5-4cf1a3c496cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:09.923725 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e5baf5f8-ac0d-41d9-888c-4208ebd15220 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372300 Jun 30 13:09:09.929957 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 165/324] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:09:09 2022] POST /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:10.057516 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-87249231-bb10-4517-8ff5-4cf1a3c496cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:10.068653 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-87249231-bb10-4517-8ff5-4cf1a3c496cf tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1368 microversion: 2.1 time: 0.180460 Jun 30 13:09:10.069509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 160/325] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:09 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:10.134287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:10.135294 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:10.143103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:10.144450 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:10.145573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:10.145970 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:10.295858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:10.304707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:10.306198 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:10.307378 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-875848b2-0b6d-4ba5-aef2-03284c8cfe5e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.177775 Jun 30 13:09:10.307935 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 166/326] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:10 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:11.085935 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d0725962-025e-437a-aea9-fc8531a41f31 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:11.086773 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d0725962-025e-437a-aea9-fc8531a41f31 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:11.094028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d0725962-025e-437a-aea9-fc8531a41f31 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:11.094506 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d0725962-025e-437a-aea9-fc8531a41f31 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:11.095266 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d0725962-025e-437a-aea9-fc8531a41f31 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:11.095688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d0725962-025e-437a-aea9-fc8531a41f31 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:11.099820 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:11.230722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d0725962-025e-437a-aea9-fc8531a41f31 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:11.238358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d0725962-025e-437a-aea9-fc8531a41f31 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1562 microversion: 2.1 time: 0.156370 Jun 30 13:09:11.239097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 161/327] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:11 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:11.255864 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-60f5f2f3-5697-40a8-8d11-6f8c3d4d59bd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:11.256358 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-60f5f2f3-5697-40a8-8d11-6f8c3d4d59bd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:11.264487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60f5f2f3-5697-40a8-8d11-6f8c3d4d59bd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:11.265196 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60f5f2f3-5697-40a8-8d11-6f8c3d4d59bd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:11.266142 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60f5f2f3-5697-40a8-8d11-6f8c3d4d59bd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:11.266662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-60f5f2f3-5697-40a8-8d11-6f8c3d4d59bd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:11.325691 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:11.326355 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:11.333993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:11.334472 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:11.335241 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:11.335643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:11.351455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-60f5f2f3-5697-40a8-8d11-6f8c3d4d59bd tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099455 Jun 30 13:09:11.352131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 167/328] 10.222.0.49 () {58 vars in 1274 bytes} [Thu Jun 30 13:09:11 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:11.473028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:11.482012 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:11.483638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:11.484808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1908a1f0-6d2b-4eb2-aac6-48552c95ed12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.163402 Jun 30 13:09:11.485380 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 162/329] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:11 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:11.854476 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd0cb805-a419-46f0-bc94-75c00e66b7dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a36ff5e4-3f96-4d94-9b18-606c12d00f93", "device": "/dev/sdb"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:11.856252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd0cb805-a419-46f0-bc94-75c00e66b7dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:11.863683 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0cb805-a419-46f0-bc94-75c00e66b7dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:11.864123 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0cb805-a419-46f0-bc94-75c00e66b7dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:11.864886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0cb805-a419-46f0-bc94-75c00e66b7dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:11.865308 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd0cb805-a419-46f0-bc94-75c00e66b7dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:12.192137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd0cb805-a419-46f0-bc94-75c00e66b7dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "POST /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342208 Jun 30 13:09:12.192871 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 168/330] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:09:11 2022] POST /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:12.326028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-36de9611-769a-4d31-b8f5-4f1cd324c57e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60ddd9f7-9575-4160-ae1e-e99bfeaab0ae"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:12.327590 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-36de9611-769a-4d31-b8f5-4f1cd324c57e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:12.336858 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36de9611-769a-4d31-b8f5-4f1cd324c57e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:12.337322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36de9611-769a-4d31-b8f5-4f1cd324c57e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:12.338291 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36de9611-769a-4d31-b8f5-4f1cd324c57e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:12.338782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36de9611-769a-4d31-b8f5-4f1cd324c57e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:12.505150 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:12.507313 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:12.515563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:12.516044 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:12.516784 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:12.517090 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:12.640664 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-36de9611-769a-4d31-b8f5-4f1cd324c57e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318300 Jun 30 13:09:12.641988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 163/331] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:09:12 2022] POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:12.662459 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-fa7d17b4-9909-42ac-9144-80a6ecf7da5d req-a2d0f58a-9d2d-4021-b652-868ac7139b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d58b08a-c2ee-4f45-90c0-400b9e677939", "tag": "f167dfd2-b19b-402d-b775-ccdceb0797f3"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:12.672879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:12.673705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-fa7d17b4-9909-42ac-9144-80a6ecf7da5d req-a2d0f58a-9d2d-4021-b652-868ac7139b63 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:12.674241 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-fa7d17b4-9909-42ac-9144-80a6ecf7da5d req-a2d0f58a-9d2d-4021-b652-868ac7139b63 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:12.683520 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:12.686271 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-fa7d17b4-9909-42ac-9144-80a6ecf7da5d req-a2d0f58a-9d2d-4021-b652-868ac7139b63 service nova] Creating event network-changed:f167dfd2-b19b-402d-b775-ccdceb0797f3 for instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 on hv-cinder-81268 Jun 30 13:09:12.686504 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:12.688435 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-01daf136-119a-4a12-beed-ec8284a4f6cc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.187804 Jun 30 13:09:12.689310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 169/332] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:12 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:09:12.692861 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-fa7d17b4-9909-42ac-9144-80a6ecf7da5d req-a2d0f58a-9d2d-4021-b652-868ac7139b63 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049197 Jun 30 13:09:12.693900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 164/333] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:13.709928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:13.710616 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:13.719450 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:13.720165 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:13.721440 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:13.722464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:13.871519 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:13.883288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:13.886022 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:13.887646 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a29ecebc-4a69-4e05-b9ee-69580da32d0e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.183014 Jun 30 13:09:13.890479 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 170/334] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:13 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:14.909608 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:14.910308 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:14.920301 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:14.920856 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:14.922029 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:14.922696 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:15.065536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:15.074275 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:15.075791 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:15.076952 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c3e4deaa-daa6-445b-92ca-051d314d3b7b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.174101 Jun 30 13:09:15.077512 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 165/335] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:14 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:16.101174 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:16.101953 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:16.109295 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:16.109730 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:16.110582 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:16.111006 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:16.244189 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:16.252243 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:16.253710 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:16.254886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6cb4de7d-ef8e-4f6d-b2a8-629205a62eab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.160190 Jun 30 13:09:16.255448 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 171/336] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:16 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:17.277199 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:17.278176 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:17.289516 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:17.290234 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:17.291517 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:17.292278 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:17.446069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:17.454955 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:17.456661 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:17.457820 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7a9363ff-3515-4810-9b09-329e74a6d833 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.187236 Jun 30 13:09:17.458361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 166/337] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:17 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:18.475434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:18.476626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:18.486262 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:18.487002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:18.487876 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:18.488371 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:18.619809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:18.628219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:18.629701 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:18.630879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-059485ec-4d62-463c-98cf-9d50828d2c83 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.159316 Jun 30 13:09:18.631400 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 172/338] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:18 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:19.643520 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f8ff9eec-69f4-4c01-b8fc-81112e002461 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: .version_select at 0x7f4ba42f91f0>, body: {"keypair": {"name": "tempest-keypair-622877281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLkb9N6dMuj79cOA4VOdEoFrJcNz0unqsK74uzPeAYCL3QR9VOr41VHoQxIgjoHYjgvpo7pj2zVr6kCnruT+ktEnhOUIh4m2F2k2BJoTsMH89mCY3/6tpN1h+tDHQZEtA=="}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:19.649039 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:19.649650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:19.656550 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:19.657003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:19.657759 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:19.658189 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:19.659171 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-f8ff9eec-69f4-4c01-b8fc-81112e002461 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for project fb73f41e81224744800e167e0eb69863. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:09:19.663471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-f8ff9eec-69f4-4c01-b8fc-81112e002461 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for user 126e2b6fc7114ec3bdc1bb3a99fcf752 and project fb73f41e81224744800e167e0eb69863. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:09:19.691564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f8ff9eec-69f4-4c01-b8fc-81112e002461 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052532 Jun 30 13:09:19.692241 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 167/339] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:09:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:19.811290 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:19.819947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:19.821775 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:19.823008 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0d945937-41be-4f0e-95cb-00600dffde86 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.178013 Jun 30 13:09:19.823659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 173/340] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:19 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:20.843527 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:20.844090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:20.850618 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:20.851059 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:20.851825 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:20.852274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:20.991747 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:21.001511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:21.003086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:21.004237 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-db14bb8c-5776-4878-be40-6c74e51553bd tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.165954 Jun 30 13:09:21.015326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 168/341] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:20 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:21.021400 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-206288110", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2789cdc0-70d1-47d5-9191-eacc6cd13622"}], "security_groups": [{"name": "tempest-securitygroup--156343662"}], "key_name": "tempest-keypair-622877281", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:21.132972 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] validate_networks() for [('2789cdc0-70d1-47d5-9191-eacc6cd13622', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:09:21.515339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:09:21.515748 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:09:21.516207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:09:21.516601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:09:21.517076 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:09:21.530619 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:21.531072 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:21.531861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:21.532282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:21.549223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for project fb73f41e81224744800e167e0eb69863. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:09:21.553139 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for user 126e2b6fc7114ec3bdc1bb3a99fcf752 and project fb73f41e81224744800e167e0eb69863. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:09:21.564773 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:09:21.567033 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:09:21.617582 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df1bd081-cf90-4650-bcfc-b144ea2466c5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.600554 Jun 30 13:09:21.618614 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 174/342] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:09:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:09:21.628711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cfd36018-830a-4b87-831e-8a837a171cb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:21.629312 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cfd36018-830a-4b87-831e-8a837a171cb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:21.703393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cfd36018-830a-4b87-831e-8a837a171cb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:21.711026 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cfd36018-830a-4b87-831e-8a837a171cb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1240 microversion: 2.1 time: 0.086173 Jun 30 13:09:21.711570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 169/343] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:21 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:22.024119 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:22.024722 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:22.032019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:22.032527 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:22.033296 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:22.033714 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:22.166117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:22.174564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:22.176059 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:22.177212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7c1ab4d9-dd0e-47b4-b31c-cd0a6bc75d01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.157266 Jun 30 13:09:22.177760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 175/344] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:22 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:22.729966 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-65438f3b-4fc4-48d3-af15-08b77e9b4297 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:22.731617 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-65438f3b-4fc4-48d3-af15-08b77e9b4297 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:22.739450 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-65438f3b-4fc4-48d3-af15-08b77e9b4297 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:22.739894 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-65438f3b-4fc4-48d3-af15-08b77e9b4297 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:22.740656 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-65438f3b-4fc4-48d3-af15-08b77e9b4297 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:22.741082 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-65438f3b-4fc4-48d3-af15-08b77e9b4297 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:22.765576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-866235688", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-11899063", "security_groups": [{"name": "tempest-secgroup-smoke-1534735831"}], "networks": [{"uuid": "2fe3aa95-1e0b-42c5-8c62-69dfb3f5a45f"}], "block_device_mapping_v2": [{"uuid": "894dd0d8-709d-455d-906a-9064f14f2cb7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:22.825764 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-65438f3b-4fc4-48d3-af15-08b77e9b4297 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:22.835010 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-65438f3b-4fc4-48d3-af15-08b77e9b4297 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1300 microversion: 2.1 time: 0.110635 Jun 30 13:09:22.835628 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 170/345] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:22 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:22.902551 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] validate_networks() for [('2fe3aa95-1e0b-42c5-8c62-69dfb3f5a45f', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:09:23.196842 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:23.197839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:23.204601 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:23.205037 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:23.205815 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:23.206409 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:23.294533 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:09:23.295039 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:09:23.295515 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:09:23.295904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:09:23.296466 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:09:23.307071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:23.307712 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:23.308449 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:23.309102 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:23.329698 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Getting quotas for project 19004d450eee426786ca037d00f8fff4. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:09:23.333701 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Getting quotas for user 9e51be11f09d44588e5b4ef657907fe6 and project 19004d450eee426786ca037d00f8fff4. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:09:23.396230 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:09:23.398365 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='894dd0d8-709d-455d-906a-9064f14f2cb7',volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:09:23.413266 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:23.421806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:23.423316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:23.424706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bbf31e61-8e85-4b83-8155-17faf6a2bc1f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.232146 Jun 30 13:09:23.425245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 171/346] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:23 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:23.535357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-242e05ff-72b5-43e0-b330-3baa9092c88f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773635 Jun 30 13:09:23.536257 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 176/347] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:09:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:09:23.546904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c46b4d13-7cd4-4e34-a8d1-d804dd18158b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:23.547510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c46b4d13-7cd4-4e34-a8d1-d804dd18158b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:23.855367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df31d8c1-de55-490f-acce-31d874123e8c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:23.856594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df31d8c1-de55-490f-acce-31d874123e8c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:23.863578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df31d8c1-de55-490f-acce-31d874123e8c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:23.864399 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df31d8c1-de55-490f-acce-31d874123e8c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:23.865246 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df31d8c1-de55-490f-acce-31d874123e8c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:23.865732 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df31d8c1-de55-490f-acce-31d874123e8c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:23.890690 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c46b4d13-7cd4-4e34-a8d1-d804dd18158b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:23.899161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c46b4d13-7cd4-4e34-a8d1-d804dd18158b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1086 microversion: 2.1 time: 0.356728 Jun 30 13:09:23.902944 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 172/348] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:23 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1086 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:23.940035 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df31d8c1-de55-490f-acce-31d874123e8c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:23.943356 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:23.951943 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df31d8c1-de55-490f-acce-31d874123e8c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1298 microversion: 2.1 time: 0.098848 Jun 30 13:09:23.955221 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 177/349] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:23 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:24.443244 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:24.443854 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:24.450670 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:24.451106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:24.451950 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:24.452714 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:24.681467 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:24.690661 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:24.692451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:24.693611 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fe6db29c-2dc0-4859-b664-d86023525a87 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.254379 Jun 30 13:09:24.694131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 173/350] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:24 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:24.832588 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-aac633f7-8a04-42e8-9024-adf608974bdf req-9d199263-4fca-47c8-b05d-92ca8b1b6aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03580d48-01c9-4c1d-bcb6-39a8914b2374", "tag": "950411eb-3cd3-48e2-ac9b-4fb6e9b617f9"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:24.837613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:24.844100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-aac633f7-8a04-42e8-9024-adf608974bdf req-9d199263-4fca-47c8-b05d-92ca8b1b6aa8 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:24.844750 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-aac633f7-8a04-42e8-9024-adf608974bdf req-9d199263-4fca-47c8-b05d-92ca8b1b6aa8 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:24.920524 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2f8a5eac-c251-4ef1-8721-2ef4815cd374 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:24.921131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2f8a5eac-c251-4ef1-8721-2ef4815cd374 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:24.923898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:24.930446 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f8a5eac-c251-4ef1-8721-2ef4815cd374 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:24.930888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f8a5eac-c251-4ef1-8721-2ef4815cd374 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:24.931668 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f8a5eac-c251-4ef1-8721-2ef4815cd374 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:24.932095 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f8a5eac-c251-4ef1-8721-2ef4815cd374 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:25.003105 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-aac633f7-8a04-42e8-9024-adf608974bdf req-9d199263-4fca-47c8-b05d-92ca8b1b6aa8 service nova] Creating event network-changed:950411eb-3cd3-48e2-ac9b-4fb6e9b617f9 for instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 on hv-cinder-81268 Jun 30 13:09:25.009191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-aac633f7-8a04-42e8-9024-adf608974bdf req-9d199263-4fca-47c8-b05d-92ca8b1b6aa8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181147 Jun 30 13:09:25.010574 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 178/351] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:25.011088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2f8a5eac-c251-4ef1-8721-2ef4815cd374 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:25.016116 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cdd66091-55ca-45c2-8051-3e2662ef41e6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:25.017116 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cdd66091-55ca-45c2-8051-3e2662ef41e6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:25.021820 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2f8a5eac-c251-4ef1-8721-2ef4815cd374 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1184 microversion: 2.1 time: 0.104043 Jun 30 13:09:25.023749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 174/352] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:24 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:25.026177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cdd66091-55ca-45c2-8051-3e2662ef41e6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:25.026650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cdd66091-55ca-45c2-8051-3e2662ef41e6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:25.027407 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cdd66091-55ca-45c2-8051-3e2662ef41e6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:25.027819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cdd66091-55ca-45c2-8051-3e2662ef41e6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:25.175558 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cdd66091-55ca-45c2-8051-3e2662ef41e6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:25.184161 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cdd66091-55ca-45c2-8051-3e2662ef41e6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.172033 Jun 30 13:09:25.184716 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 179/353] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:25 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:25.712769 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:25.713708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:25.721303 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:25.721739 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:25.722538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:25.722956 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:25.865420 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:25.874261 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:25.875788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:25.876989 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-417a4125-277d-42cc-9f58-4ed60a91107f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.168301 Jun 30 13:09:25.877548 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 175/354] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:25 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:26.044602 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c1cefd71-5c71-4527-bacf-b34e6e8d732d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:26.045548 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c1cefd71-5c71-4527-bacf-b34e6e8d732d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:26.052378 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1cefd71-5c71-4527-bacf-b34e6e8d732d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:26.052811 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1cefd71-5c71-4527-bacf-b34e6e8d732d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:26.053561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1cefd71-5c71-4527-bacf-b34e6e8d732d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:26.053978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c1cefd71-5c71-4527-bacf-b34e6e8d732d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:26.121824 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c1cefd71-5c71-4527-bacf-b34e6e8d732d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:26.129721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c1cefd71-5c71-4527-bacf-b34e6e8d732d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1202 microversion: 2.1 time: 0.091685 Jun 30 13:09:26.130270 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 180/355] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:26 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:26.202672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-55329775-898d-4300-af24-e3c4f2e1ba0a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:26.202672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-55329775-898d-4300-af24-e3c4f2e1ba0a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:26.215341 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55329775-898d-4300-af24-e3c4f2e1ba0a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:26.216136 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55329775-898d-4300-af24-e3c4f2e1ba0a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:26.216991 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55329775-898d-4300-af24-e3c4f2e1ba0a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:26.217428 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55329775-898d-4300-af24-e3c4f2e1ba0a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:26.465552 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-55329775-898d-4300-af24-e3c4f2e1ba0a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:26.477625 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-55329775-898d-4300-af24-e3c4f2e1ba0a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.279371 Jun 30 13:09:26.478674 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 176/356] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:26 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:26.897610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:26.898408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:26.909909 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:26.910358 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:26.911285 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:26.911739 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:27.049305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:27.058188 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:27.059761 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:27.060905 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dde0a5cf-38b8-4cfc-aaf2-b6e4082e8307 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.169243 Jun 30 13:09:27.061491 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 181/357] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:26 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:27.146564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-628389e7-a4d3-4219-82b4-e9a3287025e2 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:27.147163 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-628389e7-a4d3-4219-82b4-e9a3287025e2 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:27.153704 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-628389e7-a4d3-4219-82b4-e9a3287025e2 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:27.154143 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-628389e7-a4d3-4219-82b4-e9a3287025e2 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:27.154928 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-628389e7-a4d3-4219-82b4-e9a3287025e2 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:27.155351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-628389e7-a4d3-4219-82b4-e9a3287025e2 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:27.301573 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-628389e7-a4d3-4219-82b4-e9a3287025e2 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:27.309257 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-628389e7-a4d3-4219-82b4-e9a3287025e2 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.166656 Jun 30 13:09:27.309808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 177/358] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:27 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:27.495209 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1bc06a83-a8d4-4b08-85a5-efbb8a9f38ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:27.495817 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1bc06a83-a8d4-4b08-85a5-efbb8a9f38ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:27.502030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bc06a83-a8d4-4b08-85a5-efbb8a9f38ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:27.502502 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bc06a83-a8d4-4b08-85a5-efbb8a9f38ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:27.503784 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bc06a83-a8d4-4b08-85a5-efbb8a9f38ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:27.503784 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1bc06a83-a8d4-4b08-85a5-efbb8a9f38ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:27.573825 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-f95b4c3d-a5cf-4b46-811a-1c3dd0ccfdb7 req-28b9f7b0-8eb0-4be0-86a1-7db6d5963c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2c8af5-6d65-4177-9434-65a1d15813c9", "name": "network-vif-plugged", "status": "completed", "tag": "c11821df-b3b9-4d4d-9e5c-85ddf105efeb"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:27.584273 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-f95b4c3d-a5cf-4b46-811a-1c3dd0ccfdb7 req-28b9f7b0-8eb0-4be0-86a1-7db6d5963c7d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:27.584707 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-f95b4c3d-a5cf-4b46-811a-1c3dd0ccfdb7 req-28b9f7b0-8eb0-4be0-86a1-7db6d5963c7d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:27.603298 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-f95b4c3d-a5cf-4b46-811a-1c3dd0ccfdb7 req-28b9f7b0-8eb0-4be0-86a1-7db6d5963c7d service nova] Creating event network-vif-plugged:c11821df-b3b9-4d4d-9e5c-85ddf105efeb for instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 on hv-cinder-81268 Jun 30 13:09:27.609097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-f95b4c3d-a5cf-4b46-811a-1c3dd0ccfdb7 req-28b9f7b0-8eb0-4be0-86a1-7db6d5963c7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038704 Jun 30 13:09:27.609759 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 178/359] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:09:27.656931 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1bc06a83-a8d4-4b08-85a5-efbb8a9f38ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:27.664502 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1bc06a83-a8d4-4b08-85a5-efbb8a9f38ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.173508 Jun 30 13:09:27.665053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 182/360] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:27 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:28.082882 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:28.083588 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:28.089954 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:28.090418 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:28.091515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:28.091929 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:28.243679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:28.252220 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:28.253704 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:28.254940 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ba4a67b3-edfa-4a3f-8590-6b03ea0db5b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.176979 Jun 30 13:09:28.255727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 179/361] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:28 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:28.325255 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b89d43e9-3ff3-44ff-8763-b2aa2958a930 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:28.325853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b89d43e9-3ff3-44ff-8763-b2aa2958a930 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:28.333054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b89d43e9-3ff3-44ff-8763-b2aa2958a930 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:28.333494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b89d43e9-3ff3-44ff-8763-b2aa2958a930 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:28.334241 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b89d43e9-3ff3-44ff-8763-b2aa2958a930 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:28.334707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b89d43e9-3ff3-44ff-8763-b2aa2958a930 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:28.470211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b89d43e9-3ff3-44ff-8763-b2aa2958a930 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:28.477989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b89d43e9-3ff3-44ff-8763-b2aa2958a930 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.156624 Jun 30 13:09:28.478512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 183/362] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:28 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:28.683097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1f86d65c-fea6-4382-b75e-1add2b875a4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:28.683729 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1f86d65c-fea6-4382-b75e-1add2b875a4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:28.691128 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1f86d65c-fea6-4382-b75e-1add2b875a4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:28.691573 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1f86d65c-fea6-4382-b75e-1add2b875a4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:28.692332 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1f86d65c-fea6-4382-b75e-1add2b875a4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:28.692761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1f86d65c-fea6-4382-b75e-1add2b875a4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:28.836431 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1f86d65c-fea6-4382-b75e-1add2b875a4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:28.838853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:28.845970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1f86d65c-fea6-4382-b75e-1add2b875a4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.168347 Jun 30 13:09:28.846565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 180/363] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:28 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:29.277613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:29.278831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:29.286385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:29.286847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:29.287587 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:29.288002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:29.434854 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:29.448234 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:29.450629 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:29.452405 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-69a0ce09-80bc-4f06-8364-aed66fea5d99 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.181214 Jun 30 13:09:29.453256 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 184/364] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:29 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:29.503034 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3a5ebf81-e539-47ad-b595-2115105500dd tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:29.503830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3a5ebf81-e539-47ad-b595-2115105500dd tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:29.515597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3a5ebf81-e539-47ad-b595-2115105500dd tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:29.516317 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3a5ebf81-e539-47ad-b595-2115105500dd tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:29.517145 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3a5ebf81-e539-47ad-b595-2115105500dd tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:29.517495 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3a5ebf81-e539-47ad-b595-2115105500dd tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:29.656099 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3a5ebf81-e539-47ad-b595-2115105500dd tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:29.664503 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3a5ebf81-e539-47ad-b595-2115105500dd tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.167884 Jun 30 13:09:29.665105 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 181/365] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:29 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:29.862641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1eaa5d2e-01a3-4f17-8604-2be1895fc9fd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:29.863448 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1eaa5d2e-01a3-4f17-8604-2be1895fc9fd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:29.870002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1eaa5d2e-01a3-4f17-8604-2be1895fc9fd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:29.870599 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1eaa5d2e-01a3-4f17-8604-2be1895fc9fd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:29.871384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1eaa5d2e-01a3-4f17-8604-2be1895fc9fd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:29.871807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1eaa5d2e-01a3-4f17-8604-2be1895fc9fd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:30.002305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1eaa5d2e-01a3-4f17-8604-2be1895fc9fd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:30.009809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1eaa5d2e-01a3-4f17-8604-2be1895fc9fd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.151177 Jun 30 13:09:30.010364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 185/366] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:29 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:30.476006 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:30.477075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:30.486660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:30.487106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:30.487855 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:30.488280 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:30.633989 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:30.642292 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:30.643873 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:30.645013 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2fd16185-9032-47f7-b3fc-329055f2ef95 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.175696 Jun 30 13:09:30.645539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 182/367] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:30 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:30.681485 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1561d08-a42d-4409-9740-4b9164b2f423 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:30.682067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1561d08-a42d-4409-9740-4b9164b2f423 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:30.689344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1561d08-a42d-4409-9740-4b9164b2f423 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:30.689781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1561d08-a42d-4409-9740-4b9164b2f423 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:30.690845 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1561d08-a42d-4409-9740-4b9164b2f423 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:30.691267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1561d08-a42d-4409-9740-4b9164b2f423 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:30.827614 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b1561d08-a42d-4409-9740-4b9164b2f423 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:30.835912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1561d08-a42d-4409-9740-4b9164b2f423 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.158382 Jun 30 13:09:30.836476 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 186/368] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:30 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:31.031043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c459c494-c1f1-4618-b6e9-05945976f0a1 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:31.032086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c459c494-c1f1-4618-b6e9-05945976f0a1 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:31.042382 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c459c494-c1f1-4618-b6e9-05945976f0a1 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:31.043150 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c459c494-c1f1-4618-b6e9-05945976f0a1 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:31.044397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c459c494-c1f1-4618-b6e9-05945976f0a1 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:31.045094 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c459c494-c1f1-4618-b6e9-05945976f0a1 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:31.180948 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c459c494-c1f1-4618-b6e9-05945976f0a1 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:31.192702 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c459c494-c1f1-4618-b6e9-05945976f0a1 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.167908 Jun 30 13:09:31.193468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 183/369] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:31 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:31.664934 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:31.665530 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:31.672488 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:31.672950 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:31.673719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:31.674137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:31.812265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:31.820929 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:31.822434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:31.823605 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1b40278f-f703-4f49-a5c6-db8570ea9716 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.162690 Jun 30 13:09:31.824159 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 187/370] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:31 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:31.853259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-619f113d-1962-436f-ba1f-50da84d16b92 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:31.853784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-619f113d-1962-436f-ba1f-50da84d16b92 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:31.860837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-619f113d-1962-436f-ba1f-50da84d16b92 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:31.861277 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-619f113d-1962-436f-ba1f-50da84d16b92 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:31.862033 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-619f113d-1962-436f-ba1f-50da84d16b92 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:31.862495 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-619f113d-1962-436f-ba1f-50da84d16b92 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:32.016439 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-619f113d-1962-436f-ba1f-50da84d16b92 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:32.024831 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-619f113d-1962-436f-ba1f-50da84d16b92 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.175592 Jun 30 13:09:32.025403 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 184/371] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:31 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:32.216998 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7b832f1d-8394-45db-a785-ee2d91e320a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:32.218011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7b832f1d-8394-45db-a785-ee2d91e320a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:32.225533 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b832f1d-8394-45db-a785-ee2d91e320a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:32.225973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b832f1d-8394-45db-a785-ee2d91e320a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:32.226773 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b832f1d-8394-45db-a785-ee2d91e320a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:32.227200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7b832f1d-8394-45db-a785-ee2d91e320a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:32.360097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7b832f1d-8394-45db-a785-ee2d91e320a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:32.368074 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7b832f1d-8394-45db-a785-ee2d91e320a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.157949 Jun 30 13:09:32.368675 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 188/372] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:32 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:32.846819 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:32.847414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:32.853712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:32.854306 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:32.854920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:32.855344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:32.982371 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:32.991096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:32.992590 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:32.993747 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-974732a1-5541-4db5-acc0-71d24048b5a7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.153446 Jun 30 13:09:32.994310 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 185/373] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:32 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:33.042115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fa5ba66f-1e72-47a6-9919-85833d627a91 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:33.042764 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fa5ba66f-1e72-47a6-9919-85833d627a91 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:33.050856 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa5ba66f-1e72-47a6-9919-85833d627a91 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:33.051292 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa5ba66f-1e72-47a6-9919-85833d627a91 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:33.052066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa5ba66f-1e72-47a6-9919-85833d627a91 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:33.052486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fa5ba66f-1e72-47a6-9919-85833d627a91 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:33.193329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fa5ba66f-1e72-47a6-9919-85833d627a91 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:33.201362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fa5ba66f-1e72-47a6-9919-85833d627a91 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.163231 Jun 30 13:09:33.201918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 189/374] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:33 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:33.388780 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b1574f1b-e7f3-4213-a1dc-7b0878e91a52 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:33.389582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b1574f1b-e7f3-4213-a1dc-7b0878e91a52 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:33.397035 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b1574f1b-e7f3-4213-a1dc-7b0878e91a52 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:33.397439 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b1574f1b-e7f3-4213-a1dc-7b0878e91a52 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:33.398188 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b1574f1b-e7f3-4213-a1dc-7b0878e91a52 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:33.398639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b1574f1b-e7f3-4213-a1dc-7b0878e91a52 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:33.531789 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b1574f1b-e7f3-4213-a1dc-7b0878e91a52 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:33.540382 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b1574f1b-e7f3-4213-a1dc-7b0878e91a52 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.157822 Jun 30 13:09:33.540965 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 186/375] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:33 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:34.016471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:34.017258 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:34.019552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:34.020203 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=12 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:34.026062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:34.026528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:34.027275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:34.027694 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:34.160085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:34.168497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:34.169983 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:34.171165 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-539a95e6-045e-48b2-92a8-7506c545121f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.159970 Jun 30 13:09:34.171767 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 190/376] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:34 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:34.222382 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2b686a4d-b051-4eda-9a69-1911a7a767da tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:34.223011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2b686a4d-b051-4eda-9a69-1911a7a767da tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:34.226385 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=8 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:34.234472 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2b686a4d-b051-4eda-9a69-1911a7a767da tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:34.235043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2b686a4d-b051-4eda-9a69-1911a7a767da tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:34.236129 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2b686a4d-b051-4eda-9a69-1911a7a767da tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:34.236728 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2b686a4d-b051-4eda-9a69-1911a7a767da tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:34.378035 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2b686a4d-b051-4eda-9a69-1911a7a767da tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:34.386128 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2b686a4d-b051-4eda-9a69-1911a7a767da tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.170178 Jun 30 13:09:34.386743 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 187/377] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:34 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:34.561861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3e708535-328f-4c29-85e6-5cba575c10c9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:34.562923 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3e708535-328f-4c29-85e6-5cba575c10c9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:34.570208 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e708535-328f-4c29-85e6-5cba575c10c9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:34.570690 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e708535-328f-4c29-85e6-5cba575c10c9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:34.571435 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e708535-328f-4c29-85e6-5cba575c10c9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:34.571851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e708535-328f-4c29-85e6-5cba575c10c9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:34.705392 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3e708535-328f-4c29-85e6-5cba575c10c9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:34.713365 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3e708535-328f-4c29-85e6-5cba575c10c9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.158046 Jun 30 13:09:34.713932 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 191/378] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:34 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:35.192915 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:35.193751 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:35.203330 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:35.204008 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:35.205145 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:35.205793 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:35.350182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:35.362358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:35.364822 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:35.366454 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ecd1eb91-8525-4a0a-adde-2eeb434b31fa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.179986 Jun 30 13:09:35.367255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 188/379] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:35 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:35.404500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c46c2b3a-cfea-4e53-8656-a68670d202d8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:35.405100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c46c2b3a-cfea-4e53-8656-a68670d202d8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:35.412454 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c46c2b3a-cfea-4e53-8656-a68670d202d8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:35.412892 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c46c2b3a-cfea-4e53-8656-a68670d202d8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:35.413648 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c46c2b3a-cfea-4e53-8656-a68670d202d8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:35.414071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c46c2b3a-cfea-4e53-8656-a68670d202d8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:35.551061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c46c2b3a-cfea-4e53-8656-a68670d202d8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:35.558906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c46c2b3a-cfea-4e53-8656-a68670d202d8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.158363 Jun 30 13:09:35.559471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 192/380] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:35 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:35.734952 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3f2017aa-dbb2-4c1f-847c-d58d22dc4f75 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:35.735988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3f2017aa-dbb2-4c1f-847c-d58d22dc4f75 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:35.743051 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3f2017aa-dbb2-4c1f-847c-d58d22dc4f75 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:35.743483 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3f2017aa-dbb2-4c1f-847c-d58d22dc4f75 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:35.744232 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3f2017aa-dbb2-4c1f-847c-d58d22dc4f75 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:35.744713 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3f2017aa-dbb2-4c1f-847c-d58d22dc4f75 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:35.884527 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3f2017aa-dbb2-4c1f-847c-d58d22dc4f75 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:35.895685 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3f2017aa-dbb2-4c1f-847c-d58d22dc4f75 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.167373 Jun 30 13:09:35.896294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 189/381] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:35 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:36.393429 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:36.394220 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:36.400766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:36.401199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:36.401941 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:36.402361 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:36.539689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:36.553031 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:36.555561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:36.557478 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1fac6f8f-0cdc-4ddb-82e8-b6387efe84a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.170747 Jun 30 13:09:36.558381 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 193/382] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:36 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:36.575955 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c9085aa0-e9e8-4064-8e9a-c025ccd2fb9e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:36.576638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c9085aa0-e9e8-4064-8e9a-c025ccd2fb9e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:36.583677 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9085aa0-e9e8-4064-8e9a-c025ccd2fb9e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:36.584119 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9085aa0-e9e8-4064-8e9a-c025ccd2fb9e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:36.584867 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9085aa0-e9e8-4064-8e9a-c025ccd2fb9e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:36.585289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9085aa0-e9e8-4064-8e9a-c025ccd2fb9e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:36.719055 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c9085aa0-e9e8-4064-8e9a-c025ccd2fb9e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:36.727214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c9085aa0-e9e8-4064-8e9a-c025ccd2fb9e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.155187 Jun 30 13:09:36.727750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 190/383] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:36 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:36.917292 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7897e45a-b3e6-46ac-b592-c70352321686 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:36.918291 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7897e45a-b3e6-46ac-b592-c70352321686 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:36.927146 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7897e45a-b3e6-46ac-b592-c70352321686 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:36.927564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7897e45a-b3e6-46ac-b592-c70352321686 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:36.928310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7897e45a-b3e6-46ac-b592-c70352321686 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:36.928739 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7897e45a-b3e6-46ac-b592-c70352321686 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:37.062381 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7897e45a-b3e6-46ac-b592-c70352321686 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:37.071371 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7897e45a-b3e6-46ac-b592-c70352321686 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.160614 Jun 30 13:09:37.072133 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 194/384] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:36 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:37.583833 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:37.584693 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:37.596174 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:37.597186 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:37.597956 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:37.598407 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:37.738876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:37.747247 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:37.748618 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-dc81a75d-970d-4b46-8b09-fec335243640 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:37.749089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:37.749203 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-dc81a75d-970d-4b46-8b09-fec335243640 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:37.749872 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7c3a7582-86e3-4464-9119-0433b3c534af tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.173138 Jun 30 13:09:37.750441 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 191/385] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:37 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:37.756180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc81a75d-970d-4b46-8b09-fec335243640 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:37.756643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc81a75d-970d-4b46-8b09-fec335243640 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:37.757405 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc81a75d-970d-4b46-8b09-fec335243640 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:37.757829 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-dc81a75d-970d-4b46-8b09-fec335243640 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:37.760450 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:37.897241 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-dc81a75d-970d-4b46-8b09-fec335243640 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:37.909454 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-dc81a75d-970d-4b46-8b09-fec335243640 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.164032 Jun 30 13:09:37.910572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 195/386] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:37 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:38.088724 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-79aa150f-ee20-4c81-913a-353e87dd71b0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:38.089247 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-79aa150f-ee20-4c81-913a-353e87dd71b0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:38.096041 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79aa150f-ee20-4c81-913a-353e87dd71b0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:38.096535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79aa150f-ee20-4c81-913a-353e87dd71b0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:38.097294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79aa150f-ee20-4c81-913a-353e87dd71b0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:38.097718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79aa150f-ee20-4c81-913a-353e87dd71b0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:38.232755 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-79aa150f-ee20-4c81-913a-353e87dd71b0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:38.240469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-79aa150f-ee20-4c81-913a-353e87dd71b0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.155823 Jun 30 13:09:38.241030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 192/387] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:38 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:38.768665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:38.769275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:38.776008 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:38.776465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:38.777307 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:38.777789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:38.921896 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:38.926616 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4a8b6c2d-c4b3-446a-935d-940c824b6d6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:38.927215 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4a8b6c2d-c4b3-446a-935d-940c824b6d6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:38.930545 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:38.932032 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:38.933182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-65f3fb6a-29c6-4578-946e-9b710c07ac50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.168751 Jun 30 13:09:38.933719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 196/388] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:38 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:38.933963 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4a8b6c2d-c4b3-446a-935d-940c824b6d6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:38.934432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4a8b6c2d-c4b3-446a-935d-940c824b6d6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:38.935252 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4a8b6c2d-c4b3-446a-935d-940c824b6d6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:38.935688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4a8b6c2d-c4b3-446a-935d-940c824b6d6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:39.081115 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4a8b6c2d-c4b3-446a-935d-940c824b6d6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:39.088975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4a8b6c2d-c4b3-446a-935d-940c824b6d6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.166244 Jun 30 13:09:39.089543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 193/389] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:38 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:39.261613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-764ad761-acc1-452c-937d-fb18e429c2ce tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:39.262707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-764ad761-acc1-452c-937d-fb18e429c2ce tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:39.275343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764ad761-acc1-452c-937d-fb18e429c2ce tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:39.275785 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764ad761-acc1-452c-937d-fb18e429c2ce tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:39.276558 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764ad761-acc1-452c-937d-fb18e429c2ce tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:39.276985 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-764ad761-acc1-452c-937d-fb18e429c2ce tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:39.422561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-764ad761-acc1-452c-937d-fb18e429c2ce tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:39.431179 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-764ad761-acc1-452c-937d-fb18e429c2ce tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.173377 Jun 30 13:09:39.431642 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 197/390] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:39 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:39.952467 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:39.953139 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:39.960104 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:39.960596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:39.961386 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:39.961806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:40.108932 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0c95284c-e470-4cfb-8896-ac1cc9983a4e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:40.109688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0c95284c-e470-4cfb-8896-ac1cc9983a4e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:40.111508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:40.116688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c95284c-e470-4cfb-8896-ac1cc9983a4e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:40.117124 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c95284c-e470-4cfb-8896-ac1cc9983a4e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:40.118075 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c95284c-e470-4cfb-8896-ac1cc9983a4e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:40.118496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0c95284c-e470-4cfb-8896-ac1cc9983a4e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:40.127987 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:40.129830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:40.131144 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8bd7f7e2-26c6-4e70-8cba-0e30899c78e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.183009 Jun 30 13:09:40.131941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 194/391] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:39 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:40.329992 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0c95284c-e470-4cfb-8896-ac1cc9983a4e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:40.343841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0c95284c-e470-4cfb-8896-ac1cc9983a4e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.238849 Jun 30 13:09:40.344496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 198/392] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:40 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:40.448381 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7cfdaf48-fa1c-4171-840a-504262973375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:40.449326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7cfdaf48-fa1c-4171-840a-504262973375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:40.455345 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cfdaf48-fa1c-4171-840a-504262973375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:40.455877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cfdaf48-fa1c-4171-840a-504262973375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:40.456824 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cfdaf48-fa1c-4171-840a-504262973375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:40.457247 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cfdaf48-fa1c-4171-840a-504262973375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:40.671168 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7cfdaf48-fa1c-4171-840a-504262973375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:40.688808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7cfdaf48-fa1c-4171-840a-504262973375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.244295 Jun 30 13:09:40.699011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 195/393] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:40 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:40.876965 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-2765da73-322b-4109-aadf-24a010a874e4 req-d62301ce-1882-4fac-af3d-edfbb5ac8400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6237f937-32a4-40da-aebc-6bc1311b08a4", "tag": "da28b1a6-cb2b-4c40-9af4-d3051711bd7c"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:40.886224 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-2765da73-322b-4109-aadf-24a010a874e4 req-d62301ce-1882-4fac-af3d-edfbb5ac8400 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:40.886694 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-2765da73-322b-4109-aadf-24a010a874e4 req-d62301ce-1882-4fac-af3d-edfbb5ac8400 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:40.899062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-2765da73-322b-4109-aadf-24a010a874e4 req-d62301ce-1882-4fac-af3d-edfbb5ac8400 service nova] Creating event network-changed:da28b1a6-cb2b-4c40-9af4-d3051711bd7c for instance 6237f937-32a4-40da-aebc-6bc1311b08a4 on hv-cinder-81268 Jun 30 13:09:40.904089 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-2765da73-322b-4109-aadf-24a010a874e4 req-d62301ce-1882-4fac-af3d-edfbb5ac8400 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031017 Jun 30 13:09:40.904700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 199/394] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:41.149470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:41.149994 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:41.157319 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:41.157751 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:41.158558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:41.158986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:41.302210 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:41.314591 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:41.316471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:41.317657 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0e49f547-a57f-436e-a1ae-928be7f99a01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.172254 Jun 30 13:09:41.318223 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 196/395] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:41 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:41.362747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-094e5ae4-5daa-4838-a48d-bb4751950aeb tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:41.363523 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-094e5ae4-5daa-4838-a48d-bb4751950aeb tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:41.370092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094e5ae4-5daa-4838-a48d-bb4751950aeb tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:41.370581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094e5ae4-5daa-4838-a48d-bb4751950aeb tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:41.371310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094e5ae4-5daa-4838-a48d-bb4751950aeb tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:41.371945 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-094e5ae4-5daa-4838-a48d-bb4751950aeb tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:41.511927 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-094e5ae4-5daa-4838-a48d-bb4751950aeb tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:41.520096 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-094e5ae4-5daa-4838-a48d-bb4751950aeb tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.162582 Jun 30 13:09:41.520670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 200/396] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:41 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:41.709282 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c244bc13-7584-46cc-8b30-d49bbcbdb084 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:41.709859 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c244bc13-7584-46cc-8b30-d49bbcbdb084 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:41.717510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c244bc13-7584-46cc-8b30-d49bbcbdb084 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:41.718020 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c244bc13-7584-46cc-8b30-d49bbcbdb084 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:41.718895 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c244bc13-7584-46cc-8b30-d49bbcbdb084 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:41.719370 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c244bc13-7584-46cc-8b30-d49bbcbdb084 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:41.736083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:41.856833 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c244bc13-7584-46cc-8b30-d49bbcbdb084 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:41.868346 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c244bc13-7584-46cc-8b30-d49bbcbdb084 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.164330 Jun 30 13:09:41.869097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 197/397] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:41 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:42.337689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:42.338473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:42.347817 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:42.348261 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:42.349034 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:42.349457 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:42.490065 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:42.498461 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:42.499963 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:42.501122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6275935b-8646-4d15-855c-ddaf6075f694 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.168275 Jun 30 13:09:42.501663 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 201/398] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:42 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:09:42.537690 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f7eadd93-6721-4841-bbee-b6794095f4ba tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:42.538263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f7eadd93-6721-4841-bbee-b6794095f4ba tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:42.544972 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f7eadd93-6721-4841-bbee-b6794095f4ba tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:42.545441 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f7eadd93-6721-4841-bbee-b6794095f4ba tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:42.546177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f7eadd93-6721-4841-bbee-b6794095f4ba tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:42.546624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f7eadd93-6721-4841-bbee-b6794095f4ba tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:42.688654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f7eadd93-6721-4841-bbee-b6794095f4ba tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:42.696686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f7eadd93-6721-4841-bbee-b6794095f4ba tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.162946 Jun 30 13:09:42.697252 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 198/399] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:42 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:42.892962 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-015c30bd-be96-44f9-b161-36e83e5be30a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:42.894007 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-015c30bd-be96-44f9-b161-36e83e5be30a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:42.904348 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-015c30bd-be96-44f9-b161-36e83e5be30a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:42.904973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-015c30bd-be96-44f9-b161-36e83e5be30a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:42.906117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-015c30bd-be96-44f9-b161-36e83e5be30a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:42.906880 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-015c30bd-be96-44f9-b161-36e83e5be30a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:43.054452 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-015c30bd-be96-44f9-b161-36e83e5be30a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:43.066037 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-015c30bd-be96-44f9-b161-36e83e5be30a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.179236 Jun 30 13:09:43.067018 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 202/400] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:42 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:43.520121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:43.520639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:43.527135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:43.527580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:43.528323 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:43.528743 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:43.662849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:43.671216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:43.672727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:43.673875 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-441095b4-c7f8-41b7-96ce-1637c5c16e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.157975 Jun 30 13:09:43.674424 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 199/401] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:43 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:43.713415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-420e379f-6aaa-40e1-85c8-c2f22a118f67 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:43.714025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-420e379f-6aaa-40e1-85c8-c2f22a118f67 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:43.721354 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420e379f-6aaa-40e1-85c8-c2f22a118f67 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:43.721792 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420e379f-6aaa-40e1-85c8-c2f22a118f67 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:43.722597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420e379f-6aaa-40e1-85c8-c2f22a118f67 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:43.723016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-420e379f-6aaa-40e1-85c8-c2f22a118f67 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:43.856477 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-420e379f-6aaa-40e1-85c8-c2f22a118f67 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:43.864403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-420e379f-6aaa-40e1-85c8-c2f22a118f67 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.154925 Jun 30 13:09:43.864979 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 203/402] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:43 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:44.087602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-da242a68-9c40-4ae3-91bc-82d2ea20bc60 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:44.088506 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-da242a68-9c40-4ae3-91bc-82d2ea20bc60 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:44.098996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-da242a68-9c40-4ae3-91bc-82d2ea20bc60 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:44.099432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-da242a68-9c40-4ae3-91bc-82d2ea20bc60 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:44.100191 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-da242a68-9c40-4ae3-91bc-82d2ea20bc60 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:44.100614 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-da242a68-9c40-4ae3-91bc-82d2ea20bc60 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:44.239294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-da242a68-9c40-4ae3-91bc-82d2ea20bc60 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:44.250817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-da242a68-9c40-4ae3-91bc-82d2ea20bc60 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.170078 Jun 30 13:09:44.251521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 200/403] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:44 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:44.696732 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:44.697777 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:44.707957 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:44.708397 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:44.709213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:44.709571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:44.881767 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0ca80382-8240-45c2-9605-3cd24acc9aed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:44.882406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0ca80382-8240-45c2-9605-3cd24acc9aed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:44.889577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0ca80382-8240-45c2-9605-3cd24acc9aed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:44.890006 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0ca80382-8240-45c2-9605-3cd24acc9aed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:44.890812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0ca80382-8240-45c2-9605-3cd24acc9aed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:44.891228 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0ca80382-8240-45c2-9605-3cd24acc9aed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:45.030494 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0ca80382-8240-45c2-9605-3cd24acc9aed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:45.040884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0ca80382-8240-45c2-9605-3cd24acc9aed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.163168 Jun 30 13:09:45.041463 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 201/404] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:44 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:45.071501 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:45.081003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:45.082835 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:45.084038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6a63ab23-a1c0-42a2-8778-1c3a4d158361 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.393826 Jun 30 13:09:45.084596 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 204/405] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:44 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:45.269239 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-06ce6419-48fa-4466-a12d-8f9306f306da tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:45.269885 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-06ce6419-48fa-4466-a12d-8f9306f306da tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:45.276097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06ce6419-48fa-4466-a12d-8f9306f306da tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:45.276530 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06ce6419-48fa-4466-a12d-8f9306f306da tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:45.277278 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06ce6419-48fa-4466-a12d-8f9306f306da tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:45.277699 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06ce6419-48fa-4466-a12d-8f9306f306da tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:45.414826 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-06ce6419-48fa-4466-a12d-8f9306f306da tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:45.426082 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-06ce6419-48fa-4466-a12d-8f9306f306da tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.160580 Jun 30 13:09:45.426676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 202/406] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:45 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:46.060102 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-12701b10-ef3d-47f0-a8ad-81bd9e08452d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:46.060920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-12701b10-ef3d-47f0-a8ad-81bd9e08452d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:46.069991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12701b10-ef3d-47f0-a8ad-81bd9e08452d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:46.070692 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12701b10-ef3d-47f0-a8ad-81bd9e08452d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:46.071919 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12701b10-ef3d-47f0-a8ad-81bd9e08452d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:46.072498 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-12701b10-ef3d-47f0-a8ad-81bd9e08452d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:46.103141 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:46.103777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:46.110960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:46.111394 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:46.112188 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:46.112613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:46.208343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-12701b10-ef3d-47f0-a8ad-81bd9e08452d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:46.216434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-12701b10-ef3d-47f0-a8ad-81bd9e08452d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.161982 Jun 30 13:09:46.217037 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 205/407] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:46 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:46.244486 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:46.252424 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:46.253934 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:46.255200 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-61ac8e64-6e6a-4b1d-97e7-28dc91ede1b9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1743 microversion: 2.20 time: 0.155914 Jun 30 13:09:46.255738 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 203/408] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:46 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:46.443397 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a52730f0-d236-4142-a8cb-d9871bcf387c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:46.444004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a52730f0-d236-4142-a8cb-d9871bcf387c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:46.450149 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a52730f0-d236-4142-a8cb-d9871bcf387c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:46.450620 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a52730f0-d236-4142-a8cb-d9871bcf387c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:46.451376 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a52730f0-d236-4142-a8cb-d9871bcf387c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:46.451792 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a52730f0-d236-4142-a8cb-d9871bcf387c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:46.493654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-06465f14-1b9c-478a-bb93-65047514a107 req-d9841a69-2501-4b96-9d3b-23a0ef176c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03580d48-01c9-4c1d-bcb6-39a8914b2374", "name": "network-vif-plugged", "status": "completed", "tag": "950411eb-3cd3-48e2-ac9b-4fb6e9b617f9"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:46.502671 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-06465f14-1b9c-478a-bb93-65047514a107 req-d9841a69-2501-4b96-9d3b-23a0ef176c9a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:46.503366 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-06465f14-1b9c-478a-bb93-65047514a107 req-d9841a69-2501-4b96-9d3b-23a0ef176c9a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:46.517345 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-06465f14-1b9c-478a-bb93-65047514a107 req-d9841a69-2501-4b96-9d3b-23a0ef176c9a service nova] Creating event network-vif-plugged:950411eb-3cd3-48e2-ac9b-4fb6e9b617f9 for instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 on hv-cinder-81268 Jun 30 13:09:46.522180 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-06465f14-1b9c-478a-bb93-65047514a107 req-d9841a69-2501-4b96-9d3b-23a0ef176c9a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Jun 30 13:09:46.522868 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 204/409] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:09:46.600175 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a52730f0-d236-4142-a8cb-d9871bcf387c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:46.608815 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a52730f0-d236-4142-a8cb-d9871bcf387c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.169471 Jun 30 13:09:46.609442 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 206/410] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:46 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:47.239412 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e078405f-3ee5-4be3-9bea-121a2be06383 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:47.240723 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e078405f-3ee5-4be3-9bea-121a2be06383 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:47.251720 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e078405f-3ee5-4be3-9bea-121a2be06383 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:47.252496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e078405f-3ee5-4be3-9bea-121a2be06383 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:47.253804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e078405f-3ee5-4be3-9bea-121a2be06383 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:47.254892 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e078405f-3ee5-4be3-9bea-121a2be06383 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:47.274036 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:47.274705 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:47.281697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:47.282134 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:47.282922 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:47.283344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:47.389602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e078405f-3ee5-4be3-9bea-121a2be06383 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:47.397194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e078405f-3ee5-4be3-9bea-121a2be06383 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.165793 Jun 30 13:09:47.397753 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 205/411] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:47 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:47.414443 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:47.422588 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:47.424066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:47.425205 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3394f954-9130-42fe-a839-77316cf5f489 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.155618 Jun 30 13:09:47.425749 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 207/412] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:47 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:47.631369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ae3ce68d-e659-40d8-93a7-cec955868b4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:47.632446 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ae3ce68d-e659-40d8-93a7-cec955868b4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:47.641309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ae3ce68d-e659-40d8-93a7-cec955868b4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:47.641880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ae3ce68d-e659-40d8-93a7-cec955868b4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:47.642808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ae3ce68d-e659-40d8-93a7-cec955868b4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:47.643331 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ae3ce68d-e659-40d8-93a7-cec955868b4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:47.881390 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ae3ce68d-e659-40d8-93a7-cec955868b4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:47.889509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ae3ce68d-e659-40d8-93a7-cec955868b4c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.263026 Jun 30 13:09:47.890088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 206/413] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:47 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:48.416916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aab90ac1-6937-4cf9-a047-491f5680e962 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:48.417492 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aab90ac1-6937-4cf9-a047-491f5680e962 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:48.427464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab90ac1-6937-4cf9-a047-491f5680e962 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:48.427886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab90ac1-6937-4cf9-a047-491f5680e962 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:48.428632 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab90ac1-6937-4cf9-a047-491f5680e962 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:48.429054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aab90ac1-6937-4cf9-a047-491f5680e962 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:48.444172 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:48.444897 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:48.451385 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:48.451823 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:48.452580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:48.453004 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:48.586591 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aab90ac1-6937-4cf9-a047-491f5680e962 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:48.588444 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:48.596348 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aab90ac1-6937-4cf9-a047-491f5680e962 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.185540 Jun 30 13:09:48.609347 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 208/414] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:48 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:48.612422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:48.614252 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:48.616031 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0e827653-2e5e-4198-87fb-5bc60e3609c2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.176047 Jun 30 13:09:48.618278 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 207/415] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:48 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:48.845425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-517ff9d1-726d-4665-964b-dd1ada66c5d6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:48.856229 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-517ff9d1-726d-4665-964b-dd1ada66c5d6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:48.856682 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-517ff9d1-726d-4665-964b-dd1ada66c5d6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:48.906757 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f1b1e7e2-234d-4b95-be37-37aa1dd0bfcb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:48.907820 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f1b1e7e2-234d-4b95-be37-37aa1dd0bfcb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:48.924644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f1b1e7e2-234d-4b95-be37-37aa1dd0bfcb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:48.925245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f1b1e7e2-234d-4b95-be37-37aa1dd0bfcb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:48.926429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f1b1e7e2-234d-4b95-be37-37aa1dd0bfcb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:48.927144 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f1b1e7e2-234d-4b95-be37-37aa1dd0bfcb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:48.934392 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-517ff9d1-726d-4665-964b-dd1ada66c5d6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Going to try to stop instance {{(pid=117825) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 13:09:49.004867 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-517ff9d1-726d-4665-964b-dd1ada66c5d6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/action" status: 202 len: 0 microversion: 2.1 time: 0.163862 Jun 30 13:09:49.005817 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 209/416] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:09:48 2022] POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:09:49.013946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-aa7a21f1-3a95-4ff7-a02d-be9fe0eceb28 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:49.014670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-aa7a21f1-3a95-4ff7-a02d-be9fe0eceb28 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:49.021175 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa7a21f1-3a95-4ff7-a02d-be9fe0eceb28 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:49.021618 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa7a21f1-3a95-4ff7-a02d-be9fe0eceb28 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:49.022422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa7a21f1-3a95-4ff7-a02d-be9fe0eceb28 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:49.022852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-aa7a21f1-3a95-4ff7-a02d-be9fe0eceb28 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:49.076567 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f1b1e7e2-234d-4b95-be37-37aa1dd0bfcb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:49.086215 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f1b1e7e2-234d-4b95-be37-37aa1dd0bfcb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1365 microversion: 2.1 time: 0.183227 Jun 30 13:09:49.087395 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 208/417] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:48 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:49.179475 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-aa7a21f1-3a95-4ff7-a02d-be9fe0eceb28 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:49.189100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-aa7a21f1-3a95-4ff7-a02d-be9fe0eceb28 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.179281 Jun 30 13:09:49.190121 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 210/418] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:49 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:49.617160 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4f00f143-f188-4968-a051-52d878f0f086 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:49.618488 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4f00f143-f188-4968-a051-52d878f0f086 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:49.627239 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f00f143-f188-4968-a051-52d878f0f086 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:49.627691 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f00f143-f188-4968-a051-52d878f0f086 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:49.628496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f00f143-f188-4968-a051-52d878f0f086 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:49.631746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f00f143-f188-4968-a051-52d878f0f086 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:49.636453 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:49.637638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:49.652689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:49.653511 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:49.654724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:49.655297 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:49.695925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:49.866916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:49.878622 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:49.880145 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:49.881560 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9fc00872-25be-4b7f-8477-c5000f60c433 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.249933 Jun 30 13:09:49.892918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 211/419] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:49 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:09:49.893254 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4f00f143-f188-4968-a051-52d878f0f086 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:49.900354 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4f00f143-f188-4968-a051-52d878f0f086 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.288381 Jun 30 13:09:49.900956 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 209/420] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:49 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:49.987556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-25e4b15f-877e-473a-93bf-c5b9b17728bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:49.988278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-25e4b15f-877e-473a-93bf-c5b9b17728bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:49.994772 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e4b15f-877e-473a-93bf-c5b9b17728bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:49.995213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e4b15f-877e-473a-93bf-c5b9b17728bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:49.996168 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e4b15f-877e-473a-93bf-c5b9b17728bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:49.996751 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25e4b15f-877e-473a-93bf-c5b9b17728bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.106105 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0dd183f9-4b50-4ad0-a5b7-0981989b58ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:50.107177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0dd183f9-4b50-4ad0-a5b7-0981989b58ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:50.121618 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0dd183f9-4b50-4ad0-a5b7-0981989b58ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.122152 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0dd183f9-4b50-4ad0-a5b7-0981989b58ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.123220 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0dd183f9-4b50-4ad0-a5b7-0981989b58ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.123664 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0dd183f9-4b50-4ad0-a5b7-0981989b58ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.232832 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-25e4b15f-877e-473a-93bf-c5b9b17728bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lazy-loading 'services' on Instance uuid 963d825e-97d2-4c17-a454-bb083fc65bb4 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:09:50.334071 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0dd183f9-4b50-4ad0-a5b7-0981989b58ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:50.342974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0dd183f9-4b50-4ad0-a5b7-0981989b58ea tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1555 microversion: 2.1 time: 0.241838 Jun 30 13:09:50.343890 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 210/421] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:50 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:50.348457 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1237adb6-4c1d-40ae-86ad-ce8e2017c160 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:50.349805 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1237adb6-4c1d-40ae-86ad-ce8e2017c160 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:50.356521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1237adb6-4c1d-40ae-86ad-ce8e2017c160 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.356804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1237adb6-4c1d-40ae-86ad-ce8e2017c160 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.357593 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1237adb6-4c1d-40ae-86ad-ce8e2017c160 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.358071 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1237adb6-4c1d-40ae-86ad-ce8e2017c160 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.389286 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-25e4b15f-877e-473a-93bf-c5b9b17728bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "DELETE /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4/os-volume_attachments/a36ff5e4-3f96-4d94-9b18-606c12d00f93" status: 202 len: 0 microversion: 2.1 time: 0.405096 Jun 30 13:09:50.390287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 212/422] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:09:49 2022] DELETE /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4/os-volume_attachments/a36ff5e4-3f96-4d94-9b18-606c12d00f93 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 13:09:50.396378 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eb1c58f2-6086-4ae0-ae3b-162cd05d83d5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:50.397560 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eb1c58f2-6086-4ae0-ae3b-162cd05d83d5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:50.433640 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb1c58f2-6086-4ae0-ae3b-162cd05d83d5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.434531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb1c58f2-6086-4ae0-ae3b-162cd05d83d5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.435685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb1c58f2-6086-4ae0-ae3b-162cd05d83d5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.436247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eb1c58f2-6086-4ae0-ae3b-162cd05d83d5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.553456 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eb1c58f2-6086-4ae0-ae3b-162cd05d83d5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161775 Jun 30 13:09:50.554243 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 213/423] 10.222.0.49 () {58 vars in 1274 bytes} [Thu Jun 30 13:09:50 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:50.561969 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1237adb6-4c1d-40ae-86ad-ce8e2017c160 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:50.574472 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1237adb6-4c1d-40ae-86ad-ce8e2017c160 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.229337 Jun 30 13:09:50.575150 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 211/424] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:50 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:50.903552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:50.904981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:50.917328 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8e6de4a8-c97c-4b6c-8398-81b186f41d4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:50.917956 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8e6de4a8-c97c-4b6c-8398-81b186f41d4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:50.919884 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.923802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.925720 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.926403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.934047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e6de4a8-c97c-4b6c-8398-81b186f41d4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.934800 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e6de4a8-c97c-4b6c-8398-81b186f41d4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:50.935750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e6de4a8-c97c-4b6c-8398-81b186f41d4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:50.936371 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e6de4a8-c97c-4b6c-8398-81b186f41d4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:51.137686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8e6de4a8-c97c-4b6c-8398-81b186f41d4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:51.146357 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8e6de4a8-c97c-4b6c-8398-81b186f41d4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1270 microversion: 2.1 time: 0.232587 Jun 30 13:09:51.155904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 212/425] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:50 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:51.237987 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:51.246497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:51.248261 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:51.249540 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ea77e56f-4eaf-4ed7-a746-50df3d96e13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.352589 Jun 30 13:09:51.250571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 214/426] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:50 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:51.593912 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-78fb4617-b4cf-4a38-8274-eee8bdc118d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:51.594632 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-78fb4617-b4cf-4a38-8274-eee8bdc118d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:51.601541 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-78fb4617-b4cf-4a38-8274-eee8bdc118d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:51.602379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-78fb4617-b4cf-4a38-8274-eee8bdc118d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:51.603546 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-78fb4617-b4cf-4a38-8274-eee8bdc118d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:51.604199 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-78fb4617-b4cf-4a38-8274-eee8bdc118d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:51.752554 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-78fb4617-b4cf-4a38-8274-eee8bdc118d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:51.761832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-78fb4617-b4cf-4a38-8274-eee8bdc118d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.172422 Jun 30 13:09:51.762734 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 213/427] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:51 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:51.890933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-0708f483-61c1-4c68-bfae-70a1b2c388b5 req-c664c486-f59d-4fc1-af06-1b1db01b4ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03580d48-01c9-4c1d-bcb6-39a8914b2374", "tag": "950411eb-3cd3-48e2-ac9b-4fb6e9b617f9"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:09:51.903370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0708f483-61c1-4c68-bfae-70a1b2c388b5 req-c664c486-f59d-4fc1-af06-1b1db01b4ca8 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:51.903797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-0708f483-61c1-4c68-bfae-70a1b2c388b5 req-c664c486-f59d-4fc1-af06-1b1db01b4ca8 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:51.915531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-0708f483-61c1-4c68-bfae-70a1b2c388b5 req-c664c486-f59d-4fc1-af06-1b1db01b4ca8 service nova] Creating event network-changed:950411eb-3cd3-48e2-ac9b-4fb6e9b617f9 for instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 on hv-cinder-81268 Jun 30 13:09:51.923884 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-0708f483-61c1-4c68-bfae-70a1b2c388b5 req-c664c486-f59d-4fc1-af06-1b1db01b4ca8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036477 Jun 30 13:09:51.928760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 215/428] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:09:52.162578 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-48b9361d-1be9-4866-89aa-8623d77a476c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:52.163203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-48b9361d-1be9-4866-89aa-8623d77a476c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:52.169781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48b9361d-1be9-4866-89aa-8623d77a476c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:52.170211 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48b9361d-1be9-4866-89aa-8623d77a476c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:52.170995 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48b9361d-1be9-4866-89aa-8623d77a476c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:52.171584 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48b9361d-1be9-4866-89aa-8623d77a476c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:52.269423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:52.270060 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:52.283048 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:52.283494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:52.284264 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:52.284838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:52.411138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-48b9361d-1be9-4866-89aa-8623d77a476c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:52.414087 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:52.422747 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-48b9361d-1be9-4866-89aa-8623d77a476c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.264141 Jun 30 13:09:52.423884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 214/429] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:52 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:52.546890 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:52.558470 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:52.561487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:52.562889 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7e43ea7-1415-440c-b170-5d21d9c7b38d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.298168 Jun 30 13:09:52.563638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 216/430] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:52 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:52.779329 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ed663609-29d8-4464-b609-184c80b276f4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:52.781983 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ed663609-29d8-4464-b609-184c80b276f4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:52.787810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed663609-29d8-4464-b609-184c80b276f4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:52.788365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed663609-29d8-4464-b609-184c80b276f4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:52.789199 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed663609-29d8-4464-b609-184c80b276f4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:52.793357 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed663609-29d8-4464-b609-184c80b276f4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:52.973985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ed663609-29d8-4464-b609-184c80b276f4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:52.983071 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ed663609-29d8-4464-b609-184c80b276f4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.207799 Jun 30 13:09:52.984146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 215/431] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:52 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:53.442003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-65025469-1c3f-461f-bd4f-3cfab5b3b719 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:53.445214 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-65025469-1c3f-461f-bd4f-3cfab5b3b719 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:53.452731 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65025469-1c3f-461f-bd4f-3cfab5b3b719 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:53.453820 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65025469-1c3f-461f-bd4f-3cfab5b3b719 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:53.454858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65025469-1c3f-461f-bd4f-3cfab5b3b719 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:53.455486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65025469-1c3f-461f-bd4f-3cfab5b3b719 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:53.587178 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:53.587829 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:53.602532 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:53.604185 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:53.605132 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:53.606063 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:53.663268 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-65025469-1c3f-461f-bd4f-3cfab5b3b719 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:53.674707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-65025469-1c3f-461f-bd4f-3cfab5b3b719 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.237235 Jun 30 13:09:53.691517 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 217/432] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:53 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:53.832461 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:53.845821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:53.847457 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:53.848706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ef6c1993-54c5-4b3f-a858-cc82367598b2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.271699 Jun 30 13:09:53.849750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 216/433] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:53 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:09:54.000854 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f912a410-94cb-446c-bfe7-d9a5ba5d0bce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:54.001783 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f912a410-94cb-446c-bfe7-d9a5ba5d0bce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:54.009838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f912a410-94cb-446c-bfe7-d9a5ba5d0bce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.012906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f912a410-94cb-446c-bfe7-d9a5ba5d0bce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.013967 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f912a410-94cb-446c-bfe7-d9a5ba5d0bce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.016014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f912a410-94cb-446c-bfe7-d9a5ba5d0bce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.195678 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f912a410-94cb-446c-bfe7-d9a5ba5d0bce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:54.209401 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f912a410-94cb-446c-bfe7-d9a5ba5d0bce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.212430 Jun 30 13:09:54.210419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 218/434] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:53 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:54.699181 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9ca72c50-89ab-4763-8629-b69d188b9cef tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:54.700481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9ca72c50-89ab-4763-8629-b69d188b9cef tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:54.707553 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ca72c50-89ab-4763-8629-b69d188b9cef tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.707992 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ca72c50-89ab-4763-8629-b69d188b9cef tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.709488 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ca72c50-89ab-4763-8629-b69d188b9cef tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.709923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ca72c50-89ab-4763-8629-b69d188b9cef tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.807043 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e5f959c5-9d19-4c3b-9e3b-98e93cc98bc7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:54.807576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e5f959c5-9d19-4c3b-9e3b-98e93cc98bc7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:54.814301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5f959c5-9d19-4c3b-9e3b-98e93cc98bc7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.815004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5f959c5-9d19-4c3b-9e3b-98e93cc98bc7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.815755 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5f959c5-9d19-4c3b-9e3b-98e93cc98bc7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.816171 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5f959c5-9d19-4c3b-9e3b-98e93cc98bc7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.842343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e5f959c5-9d19-4c3b-9e3b-98e93cc98bc7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:09:54.859804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9ca72c50-89ab-4763-8629-b69d188b9cef tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:54.868743 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9ca72c50-89ab-4763-8629-b69d188b9cef tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.173465 Jun 30 13:09:54.874968 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 217/435] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:54 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:54.882263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:54.882936 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:54.889345 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.889787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.890671 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.891729 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.958403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e5f959c5-9d19-4c3b-9e3b-98e93cc98bc7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "DELETE /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 204 len: 0 microversion: 2.1 time: 0.154619 Jun 30 13:09:54.962075 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 219/436] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:09:54 2022] DELETE /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:09:54.968003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7cb0db6f-5d1d-4a25-a75d-3afa953f5e29 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:54.968785 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7cb0db6f-5d1d-4a25-a75d-3afa953f5e29 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:54.975704 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cb0db6f-5d1d-4a25-a75d-3afa953f5e29 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.976431 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cb0db6f-5d1d-4a25-a75d-3afa953f5e29 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:54.977404 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cb0db6f-5d1d-4a25-a75d-3afa953f5e29 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:54.977985 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cb0db6f-5d1d-4a25-a75d-3afa953f5e29 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:55.061722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:55.071579 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:55.073913 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:55.075131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4d90df04-07ba-4b7e-ad07-184fc467f4a0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.198981 Jun 30 13:09:55.075986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 218/437] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:54 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:55.140452 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7cb0db6f-5d1d-4a25-a75d-3afa953f5e29 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:55.148809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7cb0db6f-5d1d-4a25-a75d-3afa953f5e29 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1513 microversion: 2.1 time: 0.185287 Jun 30 13:09:55.149525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 220/438] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:54 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:55.228637 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b16aa0ed-5577-4467-947e-9c654ff58d2e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:55.229185 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b16aa0ed-5577-4467-947e-9c654ff58d2e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:55.231127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=90 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:55.236474 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b16aa0ed-5577-4467-947e-9c654ff58d2e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:55.236912 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b16aa0ed-5577-4467-947e-9c654ff58d2e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:55.237667 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b16aa0ed-5577-4467-947e-9c654ff58d2e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:55.238091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b16aa0ed-5577-4467-947e-9c654ff58d2e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:55.370110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b16aa0ed-5577-4467-947e-9c654ff58d2e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:55.378841 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b16aa0ed-5577-4467-947e-9c654ff58d2e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.155013 Jun 30 13:09:55.381997 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 219/439] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:55 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:55.885304 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ab83e12-1d8c-4e18-a94a-1ddcd1a3507d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:55.885916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9ab83e12-1d8c-4e18-a94a-1ddcd1a3507d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:55.888316 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:55.893643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ab83e12-1d8c-4e18-a94a-1ddcd1a3507d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:55.894067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ab83e12-1d8c-4e18-a94a-1ddcd1a3507d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:55.895034 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ab83e12-1d8c-4e18-a94a-1ddcd1a3507d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:55.895668 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ab83e12-1d8c-4e18-a94a-1ddcd1a3507d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:56.038195 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9ab83e12-1d8c-4e18-a94a-1ddcd1a3507d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:56.046850 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ab83e12-1d8c-4e18-a94a-1ddcd1a3507d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.165334 Jun 30 13:09:56.047432 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 221/440] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:55 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:56.107687 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:56.108407 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:56.118770 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:56.118770 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:56.118770 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:56.119213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:56.168460 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1fa33bfc-a5a2-43ab-9884-12b90da024b7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:56.171556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1fa33bfc-a5a2-43ab-9884-12b90da024b7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:56.177519 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fa33bfc-a5a2-43ab-9884-12b90da024b7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:56.177942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fa33bfc-a5a2-43ab-9884-12b90da024b7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:56.179869 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fa33bfc-a5a2-43ab-9884-12b90da024b7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:56.180305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1fa33bfc-a5a2-43ab-9884-12b90da024b7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:56.320003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:56.331035 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:56.333057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:56.335101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-816a1701-06d5-41a3-8f05-65e26e703478 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.231802 Jun 30 13:09:56.335669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 220/441] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:56 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:56.369474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1fa33bfc-a5a2-43ab-9884-12b90da024b7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:56.377365 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1fa33bfc-a5a2-43ab-9884-12b90da024b7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1513 microversion: 2.1 time: 0.213128 Jun 30 13:09:56.377996 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 222/442] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:56 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:56.395822 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9b8e34bc-e281-4a36-8a91-168a1fa33cd6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:56.396498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9b8e34bc-e281-4a36-8a91-168a1fa33cd6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:56.402668 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b8e34bc-e281-4a36-8a91-168a1fa33cd6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:56.403106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b8e34bc-e281-4a36-8a91-168a1fa33cd6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:56.403862 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b8e34bc-e281-4a36-8a91-168a1fa33cd6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:56.404281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b8e34bc-e281-4a36-8a91-168a1fa33cd6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:56.548672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9b8e34bc-e281-4a36-8a91-168a1fa33cd6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:56.558741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9b8e34bc-e281-4a36-8a91-168a1fa33cd6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.166723 Jun 30 13:09:56.559782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 221/443] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:56 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:57.064697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2d3ffe2-2954-461d-a5f1-7366dc6df4e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:57.066707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2d3ffe2-2954-461d-a5f1-7366dc6df4e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:57.075183 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2d3ffe2-2954-461d-a5f1-7366dc6df4e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:57.076564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2d3ffe2-2954-461d-a5f1-7366dc6df4e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:57.077582 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2d3ffe2-2954-461d-a5f1-7366dc6df4e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:57.078197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2d3ffe2-2954-461d-a5f1-7366dc6df4e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:57.239794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a2d3ffe2-2954-461d-a5f1-7366dc6df4e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:57.248841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2d3ffe2-2954-461d-a5f1-7366dc6df4e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.188358 Jun 30 13:09:57.258185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 223/444] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:57 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:57.355202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:57.355888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:57.362558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:57.363116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:57.363891 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:57.364348 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:57.396744 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9386fb31-915b-4ac0-8b48-cdd36c4c6ac2 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:57.397469 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9386fb31-915b-4ac0-8b48-cdd36c4c6ac2 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:57.404095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9386fb31-915b-4ac0-8b48-cdd36c4c6ac2 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:57.404551 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9386fb31-915b-4ac0-8b48-cdd36c4c6ac2 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:57.407170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9386fb31-915b-4ac0-8b48-cdd36c4c6ac2 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:57.407170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9386fb31-915b-4ac0-8b48-cdd36c4c6ac2 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:57.529561 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:57.541315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:57.543296 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:57.545511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fa79ceea-517f-4956-b943-d086bd068d2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.193816 Jun 30 13:09:57.546370 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 222/445] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:57 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:57.576553 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-80638504-a7a3-49bf-b704-add646b46fe3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:57.577168 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-80638504-a7a3-49bf-b704-add646b46fe3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:57.583046 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9386fb31-915b-4ac0-8b48-cdd36c4c6ac2 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:57.584574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-80638504-a7a3-49bf-b704-add646b46fe3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:57.585080 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-80638504-a7a3-49bf-b704-add646b46fe3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:57.585923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-80638504-a7a3-49bf-b704-add646b46fe3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:57.586466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-80638504-a7a3-49bf-b704-add646b46fe3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:57.592760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9386fb31-915b-4ac0-8b48-cdd36c4c6ac2 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1513 microversion: 2.1 time: 0.200976 Jun 30 13:09:57.593224 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 224/446] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:57 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:57.766844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-80638504-a7a3-49bf-b704-add646b46fe3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:57.787239 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-80638504-a7a3-49bf-b704-add646b46fe3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.214126 Jun 30 13:09:57.799535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 223/447] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:57 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:58.268325 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4e0052d4-0922-46cc-bbbb-546556209ad0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:58.268991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4e0052d4-0922-46cc-bbbb-546556209ad0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:58.280166 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e0052d4-0922-46cc-bbbb-546556209ad0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:58.280672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e0052d4-0922-46cc-bbbb-546556209ad0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:58.281370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e0052d4-0922-46cc-bbbb-546556209ad0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:58.281791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4e0052d4-0922-46cc-bbbb-546556209ad0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:58.439915 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4e0052d4-0922-46cc-bbbb-546556209ad0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:58.450019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4e0052d4-0922-46cc-bbbb-546556209ad0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.186714 Jun 30 13:09:58.451192 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 225/448] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:58 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:58.564813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:58.566083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:58.573358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:58.573867 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:58.574686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:58.575436 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:58.609860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0990ec19-ae89-4ef0-b841-3ef8a2744d56 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:58.610630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0990ec19-ae89-4ef0-b841-3ef8a2744d56 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:58.617479 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0990ec19-ae89-4ef0-b841-3ef8a2744d56 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:58.617922 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0990ec19-ae89-4ef0-b841-3ef8a2744d56 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:58.618713 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0990ec19-ae89-4ef0-b841-3ef8a2744d56 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:58.619134 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0990ec19-ae89-4ef0-b841-3ef8a2744d56 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:58.729922 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:58.741166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:58.750311 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:58.751676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a522c44d-1fe3-40eb-9d74-82bcd5ca5f10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.190949 Jun 30 13:09:58.752532 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 224/449] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:58 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:09:58.798472 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0990ec19-ae89-4ef0-b841-3ef8a2744d56 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:58.808184 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:09:58.810790 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0990ec19-ae89-4ef0-b841-3ef8a2744d56 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1513 microversion: 2.1 time: 0.204658 Jun 30 13:09:58.811617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 226/450] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:58 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:09:58.825722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b4e7ba59-af83-4b60-ab31-461f10a0c67a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:58.825722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b4e7ba59-af83-4b60-ab31-461f10a0c67a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:58.843141 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4e7ba59-af83-4b60-ab31-461f10a0c67a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:58.843600 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4e7ba59-af83-4b60-ab31-461f10a0c67a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:58.844455 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4e7ba59-af83-4b60-ab31-461f10a0c67a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:58.844901 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4e7ba59-af83-4b60-ab31-461f10a0c67a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:59.024385 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b4e7ba59-af83-4b60-ab31-461f10a0c67a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:59.034269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b4e7ba59-af83-4b60-ab31-461f10a0c67a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.221753 Jun 30 13:09:59.035551 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 225/451] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:58 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:59.468392 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-828d71f6-0b56-4c16-a25c-06a1b74a29ca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:59.469004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-828d71f6-0b56-4c16-a25c-06a1b74a29ca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:59.476606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-828d71f6-0b56-4c16-a25c-06a1b74a29ca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:59.477039 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-828d71f6-0b56-4c16-a25c-06a1b74a29ca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:59.477797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-828d71f6-0b56-4c16-a25c-06a1b74a29ca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:59.478219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-828d71f6-0b56-4c16-a25c-06a1b74a29ca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:59.625984 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-828d71f6-0b56-4c16-a25c-06a1b74a29ca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:59.634755 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-828d71f6-0b56-4c16-a25c-06a1b74a29ca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.171011 Jun 30 13:09:59.635571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 227/452] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:59 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:09:59.778469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:59.779114 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:59.786764 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:59.787412 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:59.788228 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:59.788652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:59.834073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5960085-bf30-4d86-a247-c033d7a59131 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:09:59.834709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5960085-bf30-4d86-a247-c033d7a59131 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:09:59.840864 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5960085-bf30-4d86-a247-c033d7a59131 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:59.841632 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5960085-bf30-4d86-a247-c033d7a59131 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:59.842386 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5960085-bf30-4d86-a247-c033d7a59131 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:09:59.842805 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5960085-bf30-4d86-a247-c033d7a59131 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:09:59.976124 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5960085-bf30-4d86-a247-c033d7a59131 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:09:59.983973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5960085-bf30-4d86-a247-c033d7a59131 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1513 microversion: 2.1 time: 0.154015 Jun 30 13:09:59.984545 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 228/453] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:09:59 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:00.049860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-459270cb-b658-4374-bb7a-f03bf7ad8e02 req-564d7d94-619f-4044-874d-e722aac194fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "963d825e-97d2-4c17-a454-bb083fc65bb4", "name": "network-vif-deleted", "tag": "c2f35fc4-db07-4a6c-b3e5-7bd5aee932e9"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:00.050052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:00.058594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:00.059058 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-459270cb-b658-4374-bb7a-f03bf7ad8e02 req-564d7d94-619f-4044-874d-e722aac194fd service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:00.059489 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-459270cb-b658-4374-bb7a-f03bf7ad8e02 req-564d7d94-619f-4044-874d-e722aac194fd service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:00.060093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:00.061244 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-eaf83050-66cb-4c83-a205-505c69160d4c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1738 microversion: 2.20 time: 0.288072 Jun 30 13:10:00.061840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 226/454] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:09:59 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:00.066568 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4419d942-eb9c-4ac7-ae85-567262f0e987 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:00.067307 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4419d942-eb9c-4ac7-ae85-567262f0e987 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:00.072575 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-459270cb-b658-4374-bb7a-f03bf7ad8e02 req-564d7d94-619f-4044-874d-e722aac194fd service nova] Creating event network-vif-deleted:c2f35fc4-db07-4a6c-b3e5-7bd5aee932e9 for instance 963d825e-97d2-4c17-a454-bb083fc65bb4 on hv-cinder-81268 Jun 30 13:10:00.073809 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4419d942-eb9c-4ac7-ae85-567262f0e987 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:00.074284 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4419d942-eb9c-4ac7-ae85-567262f0e987 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:00.075078 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4419d942-eb9c-4ac7-ae85-567262f0e987 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:00.075504 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4419d942-eb9c-4ac7-ae85-567262f0e987 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:00.077728 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-459270cb-b658-4374-bb7a-f03bf7ad8e02 req-564d7d94-619f-4044-874d-e722aac194fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033503 Jun 30 13:10:00.078492 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 229/455] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:10:00.213230 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4419d942-eb9c-4ac7-ae85-567262f0e987 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:00.226884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4419d942-eb9c-4ac7-ae85-567262f0e987 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.163744 Jun 30 13:10:00.227703 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 227/456] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:00 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:00.653639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2578ddfd-72bd-4e67-8070-7078159c0fb9 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:00.654415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2578ddfd-72bd-4e67-8070-7078159c0fb9 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:00.661512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2578ddfd-72bd-4e67-8070-7078159c0fb9 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:00.661930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2578ddfd-72bd-4e67-8070-7078159c0fb9 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:00.662746 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2578ddfd-72bd-4e67-8070-7078159c0fb9 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:00.663169 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2578ddfd-72bd-4e67-8070-7078159c0fb9 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:00.797569 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2578ddfd-72bd-4e67-8070-7078159c0fb9 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:00.806777 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2578ddfd-72bd-4e67-8070-7078159c0fb9 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.158034 Jun 30 13:10:00.807340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 230/457] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:00 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:01.001103 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:01.001701 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:01.008931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.009360 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.010111 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.010568 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.041295 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.041725 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.042157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lazy-loading 'fault' on Instance uuid 963d825e-97d2-4c17-a454-bb083fc65bb4 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:10:01.080247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:01.080939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:01.087364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.087886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.088716 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.089208 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.094014 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:01.101705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e2afde87-0ecf-4ad6-ad12-0705424d76e7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 200 len: 1308 microversion: 2.1 time: 0.104529 Jun 30 13:10:01.102246 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 228/458] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:00 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:01.221159 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:01.232383 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:01.234896 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:01.237148 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c74629d5-5a72-4e1d-84c7-a09890a6a59c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1720 microversion: 2.20 time: 0.160690 Jun 30 13:10:01.237975 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 231/459] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:01 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:01.252644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-66a3915c-57c4-4bb3-b325-7bf9dd7a44b6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:01.253404 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-66a3915c-57c4-4bb3-b325-7bf9dd7a44b6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:01.260324 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-66a3915c-57c4-4bb3-b325-7bf9dd7a44b6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.260758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-66a3915c-57c4-4bb3-b325-7bf9dd7a44b6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.261551 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-66a3915c-57c4-4bb3-b325-7bf9dd7a44b6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.261970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-66a3915c-57c4-4bb3-b325-7bf9dd7a44b6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.476088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-66a3915c-57c4-4bb3-b325-7bf9dd7a44b6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:01.486820 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-66a3915c-57c4-4bb3-b325-7bf9dd7a44b6 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.240493 Jun 30 13:10:01.497101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 229/460] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:01 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:01.823856 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bfd99082-7cc7-41a5-b7eb-1a78d6297da5 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:01.824427 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bfd99082-7cc7-41a5-b7eb-1a78d6297da5 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:01.831164 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfd99082-7cc7-41a5-b7eb-1a78d6297da5 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.831598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfd99082-7cc7-41a5-b7eb-1a78d6297da5 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.832350 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfd99082-7cc7-41a5-b7eb-1a78d6297da5 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:01.832790 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bfd99082-7cc7-41a5-b7eb-1a78d6297da5 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:01.972640 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bfd99082-7cc7-41a5-b7eb-1a78d6297da5 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:01.981093 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bfd99082-7cc7-41a5-b7eb-1a78d6297da5 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.161183 Jun 30 13:10:01.981663 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 232/461] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:01 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:02.120200 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:02.120851 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 963d825e-97d2-4c17-a454-bb083fc65bb4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:02.129069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:02.129578 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:02.130660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:02.131192 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:02.144683 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] HTTP exception thrown: Instance 963d825e-97d2-4c17-a454-bb083fc65bb4 could not be found. Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Request method failure captured: Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 HTTP/1.1 Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivaBENkx_eZkgXem3dM9-QBtKzgVhHt8_Lqxq8P1IN7U_LPgkIXYO-ot-Fp_XjM0kssB_8tP1JHNOPD5gPOj51Y10VLuFuphb5i0_KsuAQJDCjye9ddvx8maDR7oq77_7YRsM58Fx58dB2Dzb_tnRdsv9el6QC5pHWpJGMYL69vYOFdE Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 22b3073c2c6f4f479aae8d37cccc7ae8 Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-VolumesSnapshotTestJSON-882730788 Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:10:02.146302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/22b3073c2c6f4f479aae8d37cccc7ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/22b3073c2c6f4f479aae8d37cccc7ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_22b3073c2c6f4f479aae8d37cccc7ae8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/22b3073c2c6f4f479aae8d37cccc7ae8"}]}] Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-VolumesSnapshotTestJSON-882730788 Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 22b3073c2c6f4f479aae8d37cccc7ae8 Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-882730788 Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-VolumesSnapshotTestJSON-882730788-project Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 79388c8109554a82b6336fd8c803005f Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-VolumesSnapshotTestJSON-882730788-project Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 963d825e-97d2-4c17-a454-bb083fc65bb4 could not be found. Jun 30 13:10:02.147843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '963d825e-97d2-4c17-a454-bb083fc65bb4'} Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 963d825e-97d2-4c17-a454-bb083fc65bb4 could not be found. Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:10:02.148790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 963d825e-97d2-4c17-a454-bb083fc65bb4 could not be found. Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 963d825e-97d2-4c17-a454-bb083fc65bb4 could not be found. Jun 30 13:10:02.150337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:10:02.151669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Returning 404 to user: Instance 963d825e-97d2-4c17-a454-bb083fc65bb4 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:10:02.151669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1698b45f-f524-4aaf-994a-c58a7e85dd77 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4" status: 404 len: 111 microversion: 2.1 time: 0.032298 Jun 30 13:10:02.151669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 230/462] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:02 2022] GET /compute/v2.1/servers/963d825e-97d2-4c17-a454-bb083fc65bb4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:10:02.262931 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:02.263544 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:02.270784 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:02.271948 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:02.272799 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:02.273298 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:02.421210 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:02.430061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:02.431605 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:02.432750 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e74ad4f7-2fb9-4471-9be0-5b2958cd976c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1720 microversion: 2.20 time: 0.174284 Jun 30 13:10:02.433315 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 233/463] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:02 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:02.508427 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cb71c48f-3fb0-4896-ad6b-eeab559116f9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:02.509479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cb71c48f-3fb0-4896-ad6b-eeab559116f9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:02.519879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb71c48f-3fb0-4896-ad6b-eeab559116f9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:02.520627 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb71c48f-3fb0-4896-ad6b-eeab559116f9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:02.521538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb71c48f-3fb0-4896-ad6b-eeab559116f9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:02.521966 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb71c48f-3fb0-4896-ad6b-eeab559116f9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:02.661835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cb71c48f-3fb0-4896-ad6b-eeab559116f9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:02.665263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:02.676898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cb71c48f-3fb0-4896-ad6b-eeab559116f9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.174866 Jun 30 13:10:02.677584 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 231/464] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:02 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:03.007067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b2d7df93-ad76-4fda-93d6-ac9ad87e477f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:03.007638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b2d7df93-ad76-4fda-93d6-ac9ad87e477f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:03.015204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2d7df93-ad76-4fda-93d6-ac9ad87e477f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:03.015659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2d7df93-ad76-4fda-93d6-ac9ad87e477f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:03.016458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2d7df93-ad76-4fda-93d6-ac9ad87e477f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:03.016906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b2d7df93-ad76-4fda-93d6-ac9ad87e477f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:03.161084 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b2d7df93-ad76-4fda-93d6-ac9ad87e477f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:03.173639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b2d7df93-ad76-4fda-93d6-ac9ad87e477f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.172617 Jun 30 13:10:03.174384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 234/465] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:02 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:03.455715 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:03.456701 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:03.468231 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:03.468945 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:03.470179 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:03.470926 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:03.604076 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:03.612393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:03.613890 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:03.615324 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-11f839ea-2cfd-4a8f-b5a6-c9614eac4606 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1720 microversion: 2.20 time: 0.166014 Jun 30 13:10:03.615878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 232/466] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:03 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:03.696170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5a97e667-8cea-4314-b075-724d1afcaf77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:03.696753 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5a97e667-8cea-4314-b075-724d1afcaf77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:03.703283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a97e667-8cea-4314-b075-724d1afcaf77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:03.703724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a97e667-8cea-4314-b075-724d1afcaf77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:03.704469 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a97e667-8cea-4314-b075-724d1afcaf77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:03.704892 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5a97e667-8cea-4314-b075-724d1afcaf77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:03.846664 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5a97e667-8cea-4314-b075-724d1afcaf77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:03.854727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5a97e667-8cea-4314-b075-724d1afcaf77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.163245 Jun 30 13:10:03.855308 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 235/467] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:03 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:04.191846 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f2978c3b-cc40-41ad-aa50-6b4cf59a506c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:04.192601 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f2978c3b-cc40-41ad-aa50-6b4cf59a506c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:04.200030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f2978c3b-cc40-41ad-aa50-6b4cf59a506c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:04.200475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f2978c3b-cc40-41ad-aa50-6b4cf59a506c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:04.201245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f2978c3b-cc40-41ad-aa50-6b4cf59a506c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:04.201673 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f2978c3b-cc40-41ad-aa50-6b4cf59a506c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:04.338496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f2978c3b-cc40-41ad-aa50-6b4cf59a506c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:04.347216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f2978c3b-cc40-41ad-aa50-6b4cf59a506c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.159711 Jun 30 13:10:04.347798 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 233/468] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:04 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:04.538199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-6b95a09c-590e-49b9-af9c-58194956d44f req-4654cfee-4ede-4d37-8c34-3e4963d09055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6237f937-32a4-40da-aebc-6bc1311b08a4", "name": "network-vif-plugged", "status": "completed", "tag": "da28b1a6-cb2b-4c40-9af4-d3051711bd7c"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:04.546613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6b95a09c-590e-49b9-af9c-58194956d44f req-4654cfee-4ede-4d37-8c34-3e4963d09055 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:04.547042 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6b95a09c-590e-49b9-af9c-58194956d44f req-4654cfee-4ede-4d37-8c34-3e4963d09055 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:04.559512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-6b95a09c-590e-49b9-af9c-58194956d44f req-4654cfee-4ede-4d37-8c34-3e4963d09055 service nova] Creating event network-vif-plugged:da28b1a6-cb2b-4c40-9af4-d3051711bd7c for instance 6237f937-32a4-40da-aebc-6bc1311b08a4 on hv-cinder-81268 Jun 30 13:10:04.564655 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-6b95a09c-590e-49b9-af9c-58194956d44f req-4654cfee-4ede-4d37-8c34-3e4963d09055 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030949 Jun 30 13:10:04.565451 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 236/469] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:10:04.634191 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:04.634972 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:04.641651 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:04.642088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:04.642874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:04.643289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:04.782281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:04.790644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:04.792120 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:04.793261 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8358bc98-532a-4932-801e-28b9c3c3878b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1720 microversion: 2.20 time: 0.163198 Jun 30 13:10:04.793800 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 234/470] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:04 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:04.877394 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7bdc0af1-dc33-413e-b232-00f3e710cc7e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:04.878590 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7bdc0af1-dc33-413e-b232-00f3e710cc7e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:04.888987 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bdc0af1-dc33-413e-b232-00f3e710cc7e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:04.889719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bdc0af1-dc33-413e-b232-00f3e710cc7e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:04.891002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bdc0af1-dc33-413e-b232-00f3e710cc7e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:04.891736 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7bdc0af1-dc33-413e-b232-00f3e710cc7e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:05.034884 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7bdc0af1-dc33-413e-b232-00f3e710cc7e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:05.043043 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7bdc0af1-dc33-413e-b232-00f3e710cc7e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.172926 Jun 30 13:10:05.043623 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 237/471] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:04 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:05.373450 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c47444a0-97cd-4ddb-8bb5-d48ec522690c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:05.374496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c47444a0-97cd-4ddb-8bb5-d48ec522690c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:05.385666 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c47444a0-97cd-4ddb-8bb5-d48ec522690c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:05.386411 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c47444a0-97cd-4ddb-8bb5-d48ec522690c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:05.387705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c47444a0-97cd-4ddb-8bb5-d48ec522690c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:05.388423 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c47444a0-97cd-4ddb-8bb5-d48ec522690c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:05.534513 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c47444a0-97cd-4ddb-8bb5-d48ec522690c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:05.545782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c47444a0-97cd-4ddb-8bb5-d48ec522690c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.178896 Jun 30 13:10:05.546686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 235/472] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:05 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:05.815761 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:05.816665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:05.824360 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:05.824802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:05.825554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:05.825981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:05.958791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:05.967428 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:05.968972 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:05.970151 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-660637e8-359d-4380-bf9e-015d4e53aa3f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1720 microversion: 2.20 time: 0.161230 Jun 30 13:10:05.970706 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 238/473] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:05 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:06.064560 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-27151a84-dceb-408d-8c22-4a0766844ae5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:06.065656 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-27151a84-dceb-408d-8c22-4a0766844ae5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:06.077563 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-27151a84-dceb-408d-8c22-4a0766844ae5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:06.078177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-27151a84-dceb-408d-8c22-4a0766844ae5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:06.079512 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-27151a84-dceb-408d-8c22-4a0766844ae5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:06.080221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-27151a84-dceb-408d-8c22-4a0766844ae5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:06.226974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-27151a84-dceb-408d-8c22-4a0766844ae5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:06.235404 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-27151a84-dceb-408d-8c22-4a0766844ae5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.177600 Jun 30 13:10:06.235972 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 236/474] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:06 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:06.569081 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-94830827-c3ce-4341-8e7e-3ede94446b89 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:06.569710 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-94830827-c3ce-4341-8e7e-3ede94446b89 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:06.576147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94830827-c3ce-4341-8e7e-3ede94446b89 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:06.576581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94830827-c3ce-4341-8e7e-3ede94446b89 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:06.577329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94830827-c3ce-4341-8e7e-3ede94446b89 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:06.577746 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94830827-c3ce-4341-8e7e-3ede94446b89 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:06.605791 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-c5f1f99a-4b5a-4a60-8103-48c4668ddd39 req-ff82df56-1592-46cc-90a2-fa3587d23c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2c8af5-6d65-4177-9434-65a1d15813c9", "name": "network-vif-unplugged", "status": "completed", "tag": "c11821df-b3b9-4d4d-9e5c-85ddf105efeb"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:06.614270 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-c5f1f99a-4b5a-4a60-8103-48c4668ddd39 req-ff82df56-1592-46cc-90a2-fa3587d23c05 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:06.614733 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-c5f1f99a-4b5a-4a60-8103-48c4668ddd39 req-ff82df56-1592-46cc-90a2-fa3587d23c05 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:06.626195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-c5f1f99a-4b5a-4a60-8103-48c4668ddd39 req-ff82df56-1592-46cc-90a2-fa3587d23c05 service nova] Creating event network-vif-unplugged:c11821df-b3b9-4d4d-9e5c-85ddf105efeb for instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 on hv-cinder-81268 Jun 30 13:10:06.632307 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-c5f1f99a-4b5a-4a60-8103-48c4668ddd39 req-ff82df56-1592-46cc-90a2-fa3587d23c05 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029274 Jun 30 13:10:06.633464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 237/475] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:10:06.709532 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-94830827-c3ce-4341-8e7e-3ede94446b89 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:06.717900 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-94830827-c3ce-4341-8e7e-3ede94446b89 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.155111 Jun 30 13:10:06.718489 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 239/476] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:06 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:06.992955 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:06.993652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:07.001384 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:07.001896 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:07.002804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:07.003281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:07.149874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:07.158426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:07.159919 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:07.161074 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-96dd8999-60f3-44fb-bbca-ccf0fcdb8468 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1720 microversion: 2.20 time: 0.174805 Jun 30 13:10:07.161636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 238/477] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:06 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:07.257112 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32ee83ae-68b2-4bbe-8ddf-7cbd391ccfc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:07.257721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-32ee83ae-68b2-4bbe-8ddf-7cbd391ccfc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:07.265579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32ee83ae-68b2-4bbe-8ddf-7cbd391ccfc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:07.266069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32ee83ae-68b2-4bbe-8ddf-7cbd391ccfc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:07.267104 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32ee83ae-68b2-4bbe-8ddf-7cbd391ccfc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:07.267694 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32ee83ae-68b2-4bbe-8ddf-7cbd391ccfc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:07.423592 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-32ee83ae-68b2-4bbe-8ddf-7cbd391ccfc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:07.431910 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-32ee83ae-68b2-4bbe-8ddf-7cbd391ccfc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1723 microversion: 2.1 time: 0.181305 Jun 30 13:10:07.432474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 240/478] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:07 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:07.735249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d1f567a8-2926-49ca-a05e-83973c0c27bf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:07.735880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d1f567a8-2926-49ca-a05e-83973c0c27bf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:07.749661 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d1f567a8-2926-49ca-a05e-83973c0c27bf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:07.750105 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d1f567a8-2926-49ca-a05e-83973c0c27bf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:07.750934 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d1f567a8-2926-49ca-a05e-83973c0c27bf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:07.751366 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d1f567a8-2926-49ca-a05e-83973c0c27bf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:07.891106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d1f567a8-2926-49ca-a05e-83973c0c27bf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:07.899253 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d1f567a8-2926-49ca-a05e-83973c0c27bf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.167909 Jun 30 13:10:07.908890 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 239/479] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:07 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:08.184637 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:08.185639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:08.196158 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.196601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.197368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.197798 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.326356 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:08.334660 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:08.336235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:08.337377 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4b5562c1-30bb-4c49-bdf6-6247d1471288 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1723 microversion: 2.20 time: 0.160222 Jun 30 13:10:08.337938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 241/480] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:08 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:08.356610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cf562318-8720-430b-b4c9-fbb73f787fcb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfaf76b9-2698-4a96-9341-197cda0e78f4"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:08.357606 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cf562318-8720-430b-b4c9-fbb73f787fcb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:08.364430 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cf562318-8720-430b-b4c9-fbb73f787fcb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.364904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cf562318-8720-430b-b4c9-fbb73f787fcb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.365733 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cf562318-8720-430b-b4c9-fbb73f787fcb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.366115 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cf562318-8720-430b-b4c9-fbb73f787fcb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.453098 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-72531d89-9586-4249-bd0f-56a7128de093 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:08.454052 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-72531d89-9586-4249-bd0f-56a7128de093 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:08.461039 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72531d89-9586-4249-bd0f-56a7128de093 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.461546 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72531d89-9586-4249-bd0f-56a7128de093 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.462310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72531d89-9586-4249-bd0f-56a7128de093 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.462761 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-72531d89-9586-4249-bd0f-56a7128de093 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.606995 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-72531d89-9586-4249-bd0f-56a7128de093 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:08.615033 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-72531d89-9586-4249-bd0f-56a7128de093 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1700 microversion: 2.1 time: 0.165941 Jun 30 13:10:08.615699 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 242/481] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:08 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1700 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:10:08.631686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ee86879-cf94-4dbc-921e-71b1c5fe1dad tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:08.638609 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ee86879-cf94-4dbc-921e-71b1c5fe1dad tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.639109 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ee86879-cf94-4dbc-921e-71b1c5fe1dad tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.662762 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ee86879-cf94-4dbc-921e-71b1c5fe1dad tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Going to try to start instance {{(pid=117825) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 13:10:08.673643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cf562318-8720-430b-b4c9-fbb73f787fcb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321504 Jun 30 13:10:08.674235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 240/482] 10.222.0.49 () {62 vars in 1363 bytes} [Thu Jun 30 13:10:08 2022] POST /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 13:10:08.699052 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:08.710620 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ee86879-cf94-4dbc-921e-71b1c5fe1dad tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/action" status: 202 len: 0 microversion: 2.1 time: 0.082415 Jun 30 13:10:08.711434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 243/483] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:10:08 2022] POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 13:10:08.719945 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4d2312bc-f54b-43e3-b789-142ba467a599 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:08.720545 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4d2312bc-f54b-43e3-b789-142ba467a599 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:08.727727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d2312bc-f54b-43e3-b789-142ba467a599 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.728163 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d2312bc-f54b-43e3-b789-142ba467a599 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.728915 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d2312bc-f54b-43e3-b789-142ba467a599 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.729338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d2312bc-f54b-43e3-b789-142ba467a599 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.797397 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-76b1ffd4-1f5b-42bf-9147-e9750d957e80 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:08.798552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-76b1ffd4-1f5b-42bf-9147-e9750d957e80 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:08.805556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76b1ffd4-1f5b-42bf-9147-e9750d957e80 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.806097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76b1ffd4-1f5b-42bf-9147-e9750d957e80 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.806971 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76b1ffd4-1f5b-42bf-9147-e9750d957e80 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.807451 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-76b1ffd4-1f5b-42bf-9147-e9750d957e80 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.877653 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4d2312bc-f54b-43e3-b789-142ba467a599 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:08.887090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4d2312bc-f54b-43e3-b789-142ba467a599 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1709 microversion: 2.1 time: 0.171171 Jun 30 13:10:08.889150 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 241/484] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:08 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:10:08.916125 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-056e3f1e-cd7c-4f2b-b189-6b53977593e6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:08.916835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-056e3f1e-cd7c-4f2b-b189-6b53977593e6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:08.925391 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-056e3f1e-cd7c-4f2b-b189-6b53977593e6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.925829 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-056e3f1e-cd7c-4f2b-b189-6b53977593e6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.926727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-056e3f1e-cd7c-4f2b-b189-6b53977593e6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.927375 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-056e3f1e-cd7c-4f2b-b189-6b53977593e6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.940989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-76b1ffd4-1f5b-42bf-9147-e9750d957e80 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/action" status: 202 len: 0 microversion: 2.20 time: 0.149186 Jun 30 13:10:08.941823 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 244/485] 10.222.0.49 () {62 vars in 1318 bytes} [Thu Jun 30 13:10:08 2022] POST /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:10:08.950655 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:08.951451 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:08.958117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.958591 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:08.959358 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:08.959788 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:09.125334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:09.125589 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-056e3f1e-cd7c-4f2b-b189-6b53977593e6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:09.133968 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-056e3f1e-cd7c-4f2b-b189-6b53977593e6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.221850 Jun 30 13:10:09.134671 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 242/486] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:08 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:10:09.135356 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:09.136835 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:09.138104 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4fc8527c-edaf-48db-8a87-b123a0c56ece tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1749 microversion: 2.20 time: 0.191746 Jun 30 13:10:09.138867 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 245/487] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:08 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1749 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:10:09.904967 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-24d8668e-c9cd-4d65-b34f-1b4a65f5a500 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:09.905563 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-24d8668e-c9cd-4d65-b34f-1b4a65f5a500 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:09.912182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-24d8668e-c9cd-4d65-b34f-1b4a65f5a500 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:09.912624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-24d8668e-c9cd-4d65-b34f-1b4a65f5a500 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:09.913740 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-24d8668e-c9cd-4d65-b34f-1b4a65f5a500 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:09.914171 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-24d8668e-c9cd-4d65-b34f-1b4a65f5a500 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:10.045529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-24d8668e-c9cd-4d65-b34f-1b4a65f5a500 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:10.053657 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-24d8668e-c9cd-4d65-b34f-1b4a65f5a500 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1709 microversion: 2.1 time: 0.152527 Jun 30 13:10:10.054258 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 243/488] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:09 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:10.155183 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-14e1b9ac-7587-4754-9a63-159de5eeea4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:10.155775 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-14e1b9ac-7587-4754-9a63-159de5eeea4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:10.160823 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:10.161509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:10.163277 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e1b9ac-7587-4754-9a63-159de5eeea4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:10.164131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e1b9ac-7587-4754-9a63-159de5eeea4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:10.165066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e1b9ac-7587-4754-9a63-159de5eeea4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:10.165494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-14e1b9ac-7587-4754-9a63-159de5eeea4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:10.168127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:10.168597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:10.169347 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:10.169775 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:10.309838 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:10.319285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:10.320888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:10.322109 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-eb4b51d4-24a1-454b-bec1-140bb01d774b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1749 microversion: 2.20 time: 0.165669 Jun 30 13:10:10.322688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 244/489] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:10 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:10.537427 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-14e1b9ac-7587-4754-9a63-159de5eeea4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:10.545662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-14e1b9ac-7587-4754-9a63-159de5eeea4a tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.395154 Jun 30 13:10:10.546266 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 246/490] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:10 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:11.073175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6944a79a-dae4-4020-bbeb-7b8521c6d743 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:11.073900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6944a79a-dae4-4020-bbeb-7b8521c6d743 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:11.080607 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6944a79a-dae4-4020-bbeb-7b8521c6d743 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:11.081044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6944a79a-dae4-4020-bbeb-7b8521c6d743 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:11.081800 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6944a79a-dae4-4020-bbeb-7b8521c6d743 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:11.082222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6944a79a-dae4-4020-bbeb-7b8521c6d743 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:11.221073 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6944a79a-dae4-4020-bbeb-7b8521c6d743 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:11.229719 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6944a79a-dae4-4020-bbeb-7b8521c6d743 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1709 microversion: 2.1 time: 0.161067 Jun 30 13:10:11.230262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 245/491] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:11 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:11.345710 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:11.346616 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:11.358106 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:11.358888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:11.360129 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:11.360839 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:11.503411 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:11.512186 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:11.513654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:11.514826 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-71385500-e217-480a-9212-060971c2d432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1749 microversion: 2.20 time: 0.176278 Jun 30 13:10:11.515378 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 247/492] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:11 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:11.565716 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f22f067a-bb62-4cd7-bfa8-56165c984090 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:11.566594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f22f067a-bb62-4cd7-bfa8-56165c984090 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:11.576108 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f22f067a-bb62-4cd7-bfa8-56165c984090 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:11.576731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f22f067a-bb62-4cd7-bfa8-56165c984090 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:11.577792 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f22f067a-bb62-4cd7-bfa8-56165c984090 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:11.578390 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f22f067a-bb62-4cd7-bfa8-56165c984090 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:11.601654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:11.737238 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f22f067a-bb62-4cd7-bfa8-56165c984090 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:11.749380 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f22f067a-bb62-4cd7-bfa8-56165c984090 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.188718 Jun 30 13:10:11.750095 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 246/493] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:11 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:12.248161 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-68b0599e-76ae-489c-80bc-e5feb949f4aa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:12.248825 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-68b0599e-76ae-489c-80bc-e5feb949f4aa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:12.255632 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68b0599e-76ae-489c-80bc-e5feb949f4aa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:12.256103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68b0599e-76ae-489c-80bc-e5feb949f4aa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:12.256873 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68b0599e-76ae-489c-80bc-e5feb949f4aa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:12.257352 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68b0599e-76ae-489c-80bc-e5feb949f4aa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:12.395218 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-68b0599e-76ae-489c-80bc-e5feb949f4aa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:12.407256 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-68b0599e-76ae-489c-80bc-e5feb949f4aa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1709 microversion: 2.1 time: 0.162984 Jun 30 13:10:12.408061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 248/494] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:12 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:12.537567 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:12.538666 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:12.546125 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:12.546594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:12.547353 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:12.547773 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:12.688280 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:12.696899 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:12.698422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:12.699587 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1a200836-9985-4a0b-8dfb-78ef9dfb2100 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1749 microversion: 2.20 time: 0.168581 Jun 30 13:10:12.700150 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 247/495] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:12 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:12.773500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4efd9d3d-4d5d-4222-81c7-bb811a2e788f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:12.774617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4efd9d3d-4d5d-4222-81c7-bb811a2e788f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:12.781322 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4efd9d3d-4d5d-4222-81c7-bb811a2e788f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:12.781783 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4efd9d3d-4d5d-4222-81c7-bb811a2e788f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:12.782613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4efd9d3d-4d5d-4222-81c7-bb811a2e788f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:12.783055 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4efd9d3d-4d5d-4222-81c7-bb811a2e788f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:12.920676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4efd9d3d-4d5d-4222-81c7-bb811a2e788f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:12.928275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4efd9d3d-4d5d-4222-81c7-bb811a2e788f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.161251 Jun 30 13:10:12.928870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 249/496] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:12 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:13.426736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f128e795-6652-4af0-ae97-fe57394f0aba tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:13.427930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f128e795-6652-4af0-ae97-fe57394f0aba tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:13.435256 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f128e795-6652-4af0-ae97-fe57394f0aba tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:13.436047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f128e795-6652-4af0-ae97-fe57394f0aba tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:13.437132 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f128e795-6652-4af0-ae97-fe57394f0aba tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:13.437544 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f128e795-6652-4af0-ae97-fe57394f0aba tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:13.665539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f128e795-6652-4af0-ae97-fe57394f0aba tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:13.676323 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f128e795-6652-4af0-ae97-fe57394f0aba tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1709 microversion: 2.1 time: 0.254621 Jun 30 13:10:13.676898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 248/497] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:13 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:13.717704 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:13.718302 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:13.725219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:13.725651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:13.726435 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:13.726857 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:13.870305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:13.878934 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:13.880509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:13.881795 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-48fab629-5568-49ad-8987-0ec00a6abe2d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1751 microversion: 2.20 time: 0.168460 Jun 30 13:10:13.882447 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 250/498] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:13 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:13.945337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-449c510b-bf01-4fc7-a52e-23bc0f37043c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:13.945944 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-449c510b-bf01-4fc7-a52e-23bc0f37043c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:13.953178 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-449c510b-bf01-4fc7-a52e-23bc0f37043c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:13.953623 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-449c510b-bf01-4fc7-a52e-23bc0f37043c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:13.954422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-449c510b-bf01-4fc7-a52e-23bc0f37043c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:13.954847 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-449c510b-bf01-4fc7-a52e-23bc0f37043c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:14.155875 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-449c510b-bf01-4fc7-a52e-23bc0f37043c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:14.164765 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-449c510b-bf01-4fc7-a52e-23bc0f37043c tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1258 microversion: 2.1 time: 0.223272 Jun 30 13:10:14.165337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 249/499] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:13 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:14.271870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1379977051", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "networks": [{"uuid": "49e5b1d1-626a-41bc-8749-76436a8ee8b4"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:14.322674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] validate_networks() for [('49e5b1d1-626a-41bc-8749-76436a8ee8b4', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:10:14.667766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:10:14.668180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:10:14.668642 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:10:14.669038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:10:14.669426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:10:14.680074 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:14.680438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:14.681260 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:14.681726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:14.693874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-876e2a07-c60c-4efc-9465-8e58bf84d2af tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:14.694910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-876e2a07-c60c-4efc-9465-8e58bf84d2af tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:14.699691 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Getting quotas for project 22b3073c2c6f4f479aae8d37cccc7ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:10:14.701998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-876e2a07-c60c-4efc-9465-8e58bf84d2af tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:14.702537 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-876e2a07-c60c-4efc-9465-8e58bf84d2af tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:14.703399 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-876e2a07-c60c-4efc-9465-8e58bf84d2af tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:14.703799 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Getting quotas for user 79388c8109554a82b6336fd8c803005f and project 22b3073c2c6f4f479aae8d37cccc7ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:10:14.703958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-876e2a07-c60c-4efc-9465-8e58bf84d2af tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:14.715092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:10:14.717712 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:10:14.765804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-04ec1c5d-8112-44e5-85b5-fe6fb275047e tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497807 Jun 30 13:10:14.767348 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 251/500] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:10:14.778555 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0541fd2b-1015-4a0b-8ac6-7b93bdbd59fa tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:14.779165 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0541fd2b-1015-4a0b-8ac6-7b93bdbd59fa tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:14.857081 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0541fd2b-1015-4a0b-8ac6-7b93bdbd59fa tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:14.865696 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0541fd2b-1015-4a0b-8ac6-7b93bdbd59fa tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1219 microversion: 2.1 time: 0.091299 Jun 30 13:10:14.866286 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 252/501] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:14 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:14.900259 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:14.901307 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:14.909000 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:14.909457 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:14.910268 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:14.912032 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:14.958705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-876e2a07-c60c-4efc-9465-8e58bf84d2af tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:14.982175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-876e2a07-c60c-4efc-9465-8e58bf84d2af tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1709 microversion: 2.1 time: 0.292143 Jun 30 13:10:14.983092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 250/502] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:14 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1709 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:15.090264 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:15.100742 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:15.102235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:15.103466 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ede5ef45-4b9b-40b2-9944-819e81223c68 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1751 microversion: 2.20 time: 0.207171 Jun 30 13:10:15.104044 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 253/503] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:14 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:15.182294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-698a0285-ef03-41d8-9512-7712df513cbc tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:15.182940 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-698a0285-ef03-41d8-9512-7712df513cbc tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:15.189146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-698a0285-ef03-41d8-9512-7712df513cbc tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:15.189582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-698a0285-ef03-41d8-9512-7712df513cbc tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:15.190425 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-698a0285-ef03-41d8-9512-7712df513cbc tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:15.190824 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-698a0285-ef03-41d8-9512-7712df513cbc tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:15.327810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-698a0285-ef03-41d8-9512-7712df513cbc tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:15.335741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-698a0285-ef03-41d8-9512-7712df513cbc tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1442 microversion: 2.1 time: 0.158369 Jun 30 13:10:15.336286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 251/504] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:15 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:15.354990 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bc277911-1dcf-4680-bb48-35f1e4f14fed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:15.355658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bc277911-1dcf-4680-bb48-35f1e4f14fed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:15.363771 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc277911-1dcf-4680-bb48-35f1e4f14fed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:15.364469 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc277911-1dcf-4680-bb48-35f1e4f14fed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:15.366081 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc277911-1dcf-4680-bb48-35f1e4f14fed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:15.366539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bc277911-1dcf-4680-bb48-35f1e4f14fed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:15.511462 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bc277911-1dcf-4680-bb48-35f1e4f14fed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:15.519186 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bc277911-1dcf-4680-bb48-35f1e4f14fed tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1442 microversion: 2.1 time: 0.169008 Jun 30 13:10:15.519745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 254/505] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:15 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:15.883516 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ed2d3d1d-0ff6-437c-b8d1-691fa192560f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:15.884135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ed2d3d1d-0ff6-437c-b8d1-691fa192560f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:15.891732 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed2d3d1d-0ff6-437c-b8d1-691fa192560f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:15.892162 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed2d3d1d-0ff6-437c-b8d1-691fa192560f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:15.892953 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed2d3d1d-0ff6-437c-b8d1-691fa192560f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:15.893376 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ed2d3d1d-0ff6-437c-b8d1-691fa192560f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:15.977089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ed2d3d1d-0ff6-437c-b8d1-691fa192560f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:15.987620 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ed2d3d1d-0ff6-437c-b8d1-691fa192560f tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1271 microversion: 2.1 time: 0.107652 Jun 30 13:10:15.988491 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 252/506] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:15 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:16.005041 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16bef731-0824-4c2a-9192-86fae70a7770 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:16.006458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16bef731-0824-4c2a-9192-86fae70a7770 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:16.014573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bef731-0824-4c2a-9192-86fae70a7770 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:16.015009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bef731-0824-4c2a-9192-86fae70a7770 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:16.015813 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bef731-0824-4c2a-9192-86fae70a7770 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:16.016344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16bef731-0824-4c2a-9192-86fae70a7770 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:16.121937 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:16.122915 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:16.142433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:16.143842 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:16.145589 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:16.147937 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:16.176580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16bef731-0824-4c2a-9192-86fae70a7770 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:16.190085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16bef731-0824-4c2a-9192-86fae70a7770 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1709 microversion: 2.1 time: 0.193079 Jun 30 13:10:16.190712 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 255/507] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:15 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1709 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:16.487086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:16.496221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:16.497705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:16.498920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b10b2165-c96c-4b86-90d4-8d4409b0431f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.381374 Jun 30 13:10:16.499475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 253/508] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:16 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:17.007643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1565bb84-6553-4c26-93bb-d84c4e6c7358 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:17.008369 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1565bb84-6553-4c26-93bb-d84c4e6c7358 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:17.016096 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1565bb84-6553-4c26-93bb-d84c4e6c7358 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:17.016547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1565bb84-6553-4c26-93bb-d84c4e6c7358 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:17.017341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1565bb84-6553-4c26-93bb-d84c4e6c7358 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:17.017762 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1565bb84-6553-4c26-93bb-d84c4e6c7358 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:17.082679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1565bb84-6553-4c26-93bb-d84c4e6c7358 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:17.090425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1565bb84-6553-4c26-93bb-d84c4e6c7358 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1271 microversion: 2.1 time: 0.086639 Jun 30 13:10:17.090997 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 256/509] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:17 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:17.208571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d18e348e-a00c-467e-8a34-11b3596f9c79 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:17.208936 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d18e348e-a00c-467e-8a34-11b3596f9c79 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:17.217621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d18e348e-a00c-467e-8a34-11b3596f9c79 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:17.217974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d18e348e-a00c-467e-8a34-11b3596f9c79 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:17.218911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d18e348e-a00c-467e-8a34-11b3596f9c79 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:17.220561 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d18e348e-a00c-467e-8a34-11b3596f9c79 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:17.525074 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:17.525848 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:17.532504 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:17.533532 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:17.534846 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:17.535472 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:17.576829 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d18e348e-a00c-467e-8a34-11b3596f9c79 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:17.589617 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d18e348e-a00c-467e-8a34-11b3596f9c79 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1713 microversion: 2.1 time: 0.384936 Jun 30 13:10:17.590983 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 254/510] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:17 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1713 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:17.779684 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:17.789137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:17.790660 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:17.791954 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7414ad5c-83e1-4c63-9cea-9d3fc9e52dd1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.270916 Jun 30 13:10:17.793005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 257/511] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:17 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:18.065954 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-e00e134f-4f33-4828-8492-072fce6a2025 req-33eca99c-6c76-4663-ae85-53c05c7e018a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6237f937-32a4-40da-aebc-6bc1311b08a4", "tag": "da28b1a6-cb2b-4c40-9af4-d3051711bd7c"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:18.075484 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-e00e134f-4f33-4828-8492-072fce6a2025 req-33eca99c-6c76-4663-ae85-53c05c7e018a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:18.075913 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-e00e134f-4f33-4828-8492-072fce6a2025 req-33eca99c-6c76-4663-ae85-53c05c7e018a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:18.097639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-e00e134f-4f33-4828-8492-072fce6a2025 req-33eca99c-6c76-4663-ae85-53c05c7e018a service nova] Creating event network-changed:da28b1a6-cb2b-4c40-9af4-d3051711bd7c for instance 6237f937-32a4-40da-aebc-6bc1311b08a4 on hv-cinder-81268 Jun 30 13:10:18.110268 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3913603-432c-4faa-b8fd-fc573a50a508 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:18.111541 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3913603-432c-4faa-b8fd-fc573a50a508 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:18.120226 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-e00e134f-4f33-4828-8492-072fce6a2025 req-33eca99c-6c76-4663-ae85-53c05c7e018a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058221 Jun 30 13:10:18.122204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3913603-432c-4faa-b8fd-fc573a50a508 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:18.122842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3913603-432c-4faa-b8fd-fc573a50a508 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:18.123776 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3913603-432c-4faa-b8fd-fc573a50a508 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:18.123943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 255/512] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:10:18.124504 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3913603-432c-4faa-b8fd-fc573a50a508 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:18.450292 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b3913603-432c-4faa-b8fd-fc573a50a508 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:18.458237 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3913603-432c-4faa-b8fd-fc573a50a508 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.353684 Jun 30 13:10:18.458891 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 258/513] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:18 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:18.812708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:18.814158 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:18.823256 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:18.823863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:18.825622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:18.826216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:18.836463 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-bdfcff28-bb59-42d1-a597-02d907e12fda req-a7dee3cc-4167-49fe-bdf4-68186c9eb59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a9d9c42-cb9f-45f6-aee6-62abf9d927f0", "tag": "8b8cd4e2-00cb-44a6-9fd8-546136c1db73"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:18.863228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-bdfcff28-bb59-42d1-a597-02d907e12fda req-a7dee3cc-4167-49fe-bdf4-68186c9eb59a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:18.863925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-bdfcff28-bb59-42d1-a597-02d907e12fda req-a7dee3cc-4167-49fe-bdf4-68186c9eb59a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:18.884299 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-bdfcff28-bb59-42d1-a597-02d907e12fda req-a7dee3cc-4167-49fe-bdf4-68186c9eb59a service nova] Creating event network-changed:8b8cd4e2-00cb-44a6-9fd8-546136c1db73 for instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 on hv-cinder-81268 Jun 30 13:10:18.895409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-bdfcff28-bb59-42d1-a597-02d907e12fda req-a7dee3cc-4167-49fe-bdf4-68186c9eb59a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062250 Jun 30 13:10:18.896486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 259/514] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:10:19.153464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:19.164607 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:19.166261 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:19.174541 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0e9ccfd4-22b0-4d52-b1d8-bab0df397ba1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.367443 Jun 30 13:10:19.191711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 256/515] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:18 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:19.480308 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d4e890a-37b9-4a20-955d-962b59faaa3a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:19.481443 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d4e890a-37b9-4a20-955d-962b59faaa3a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:19.493326 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d4e890a-37b9-4a20-955d-962b59faaa3a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:19.494010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d4e890a-37b9-4a20-955d-962b59faaa3a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:19.495182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d4e890a-37b9-4a20-955d-962b59faaa3a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:19.495610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d4e890a-37b9-4a20-955d-962b59faaa3a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:19.634706 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2d4e890a-37b9-4a20-955d-962b59faaa3a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:19.642541 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d4e890a-37b9-4a20-955d-962b59faaa3a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.169235 Jun 30 13:10:19.643108 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 260/516] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:19 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:20.194558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:20.195335 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:20.203934 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:20.204386 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:20.205422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:20.206017 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:20.352410 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:20.361319 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:20.362844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:20.363976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b5658120-98c7-4783-af8d-d10444c92e53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.173865 Jun 30 13:10:20.364512 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 257/517] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:20 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:20.662654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-95490b46-bf32-4c1c-9058-d71cc4462913 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:20.663794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-95490b46-bf32-4c1c-9058-d71cc4462913 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:20.672344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95490b46-bf32-4c1c-9058-d71cc4462913 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:20.672770 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95490b46-bf32-4c1c-9058-d71cc4462913 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:20.673534 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95490b46-bf32-4c1c-9058-d71cc4462913 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:20.673959 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-95490b46-bf32-4c1c-9058-d71cc4462913 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:20.807234 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-95490b46-bf32-4c1c-9058-d71cc4462913 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:20.809861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:20.816273 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-95490b46-bf32-4c1c-9058-d71cc4462913 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.160144 Jun 30 13:10:20.816858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 261/518] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:20 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:21.382902 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:21.383502 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:21.391157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:21.391333 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:21.392072 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:21.392545 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:21.531152 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:21.539580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:21.541053 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:21.542200 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-36b61b04-253b-4a77-9b6c-2925c96fcdf1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.163426 Jun 30 13:10:21.542788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 258/519] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:21 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:21.833956 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-80c1db44-0787-4ad8-902f-40b139fa08f8 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:21.834652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-80c1db44-0787-4ad8-902f-40b139fa08f8 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:21.836895 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:21.844479 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80c1db44-0787-4ad8-902f-40b139fa08f8 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:21.844923 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80c1db44-0787-4ad8-902f-40b139fa08f8 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:21.845679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80c1db44-0787-4ad8-902f-40b139fa08f8 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:21.846104 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-80c1db44-0787-4ad8-902f-40b139fa08f8 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:21.983459 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-80c1db44-0787-4ad8-902f-40b139fa08f8 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:21.992533 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-80c1db44-0787-4ad8-902f-40b139fa08f8 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.162287 Jun 30 13:10:21.993451 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 262/520] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:21 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:22.562900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:22.563567 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:22.570377 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:22.570998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:22.571864 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:22.572398 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:22.712040 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:22.722419 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:22.723941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:22.725147 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-76211207-7c50-41b8-893c-06ab40c73f41 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.167241 Jun 30 13:10:22.725893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 259/521] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:22 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:23.009524 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3efc269-8ecf-49a6-be09-b7947f7386bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:23.010190 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3efc269-8ecf-49a6-be09-b7947f7386bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:23.017656 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3efc269-8ecf-49a6-be09-b7947f7386bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:23.018103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3efc269-8ecf-49a6-be09-b7947f7386bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:23.019056 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3efc269-8ecf-49a6-be09-b7947f7386bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:23.019483 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3efc269-8ecf-49a6-be09-b7947f7386bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:23.160208 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b3efc269-8ecf-49a6-be09-b7947f7386bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:23.168124 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3efc269-8ecf-49a6-be09-b7947f7386bb tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.162521 Jun 30 13:10:23.168723 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 263/522] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:23 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:23.744352 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:23.745094 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:23.751924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:23.752365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:23.753112 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:23.753529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:23.899935 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:23.909768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:23.912012 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:23.913550 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8f6fafc6-4f8c-4f63-bf7c-fc2e7eeb5093 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.173201 Jun 30 13:10:23.922383 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 260/523] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:23 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:24.185383 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a380b25-f16c-4b42-bff1-473df70db70a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:24.185980 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8a380b25-f16c-4b42-bff1-473df70db70a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:24.192882 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a380b25-f16c-4b42-bff1-473df70db70a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:24.193318 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a380b25-f16c-4b42-bff1-473df70db70a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:24.194063 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a380b25-f16c-4b42-bff1-473df70db70a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:24.194556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a380b25-f16c-4b42-bff1-473df70db70a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:24.340246 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8a380b25-f16c-4b42-bff1-473df70db70a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:24.348499 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8a380b25-f16c-4b42-bff1-473df70db70a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.167123 Jun 30 13:10:24.349111 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 264/524] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:24 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:24.933229 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:24.933912 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:24.941141 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:24.941555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:24.942433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:24.942860 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:25.079233 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:25.088269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:25.089798 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:25.091011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-64975c0c-3d04-49a5-a2ca-7f97e1554b7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.162197 Jun 30 13:10:25.091912 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 261/525] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:24 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:25.365370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f737aa3b-8d13-412c-b8c6-1d669e7539cc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:25.366017 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f737aa3b-8d13-412c-b8c6-1d669e7539cc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:25.367852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:25.368520 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=8 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:25.377408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f737aa3b-8d13-412c-b8c6-1d669e7539cc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:25.377897 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f737aa3b-8d13-412c-b8c6-1d669e7539cc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:25.378688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f737aa3b-8d13-412c-b8c6-1d669e7539cc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:25.379115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f737aa3b-8d13-412c-b8c6-1d669e7539cc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:25.542390 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f737aa3b-8d13-412c-b8c6-1d669e7539cc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:25.550248 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f737aa3b-8d13-412c-b8c6-1d669e7539cc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.188902 Jun 30 13:10:25.550841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 265/526] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:25 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:26.109562 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:26.110234 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:26.112736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=88 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:26.120216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:26.120975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:26.122147 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:26.122895 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:26.270169 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:26.278988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:26.280473 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:26.281621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fc819acf-c961-4b61-8dd2-38cd24b45a7a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.176108 Jun 30 13:10:26.282177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 262/527] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:26 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:26.568012 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41c8f526-aef4-445b-af95-9a188e9b8603 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:26.568613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-41c8f526-aef4-445b-af95-9a188e9b8603 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:26.575016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41c8f526-aef4-445b-af95-9a188e9b8603 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:26.575456 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41c8f526-aef4-445b-af95-9a188e9b8603 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:26.576206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41c8f526-aef4-445b-af95-9a188e9b8603 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:26.576627 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41c8f526-aef4-445b-af95-9a188e9b8603 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:26.727703 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-41c8f526-aef4-445b-af95-9a188e9b8603 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:26.735781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41c8f526-aef4-445b-af95-9a188e9b8603 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.172274 Jun 30 13:10:26.736906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 266/528] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:26 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:27.302577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:27.303691 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:27.312145 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:27.312560 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:27.313350 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:27.313778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:27.457781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:27.460089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:27.467751 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:27.469234 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:27.470447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-18605d15-8c3a-4aa4-8e9b-6c3dfc4fd63c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.172011 Jun 30 13:10:27.471012 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 263/529] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:27 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:27.753403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0814d436-ec5b-404e-85c1-0ba21ddd51dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:27.754130 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0814d436-ec5b-404e-85c1-0ba21ddd51dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:27.760649 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814d436-ec5b-404e-85c1-0ba21ddd51dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:27.761086 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814d436-ec5b-404e-85c1-0ba21ddd51dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:27.761829 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814d436-ec5b-404e-85c1-0ba21ddd51dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:27.762250 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0814d436-ec5b-404e-85c1-0ba21ddd51dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:27.896508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0814d436-ec5b-404e-85c1-0ba21ddd51dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:27.903961 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0814d436-ec5b-404e-85c1-0ba21ddd51dc tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.154568 Jun 30 13:10:27.904520 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 267/530] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:27 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:28.490877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:28.491548 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:28.498642 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:28.499083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:28.499828 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:28.500254 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:28.638935 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:28.648304 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:28.649808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:28.651012 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3bf4b88e-9a0a-4ce1-af09-153d7f55e435 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.165559 Jun 30 13:10:28.651582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 264/531] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:28 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:28.926483 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-00755946-76b2-4fd7-9e53-170f6d8fb196 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:28.928012 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-00755946-76b2-4fd7-9e53-170f6d8fb196 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:28.939066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00755946-76b2-4fd7-9e53-170f6d8fb196 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:28.940633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00755946-76b2-4fd7-9e53-170f6d8fb196 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:28.941412 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00755946-76b2-4fd7-9e53-170f6d8fb196 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:28.942076 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-00755946-76b2-4fd7-9e53-170f6d8fb196 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:29.085982 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-00755946-76b2-4fd7-9e53-170f6d8fb196 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:29.097082 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-00755946-76b2-4fd7-9e53-170f6d8fb196 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.179189 Jun 30 13:10:29.097644 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 268/532] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:28 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:29.673831 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:29.674891 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:29.682294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:29.683050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:29.684034 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:29.684645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:29.830844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:29.839381 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:29.840862 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:29.842705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2425d9dd-4068-4c80-a286-b9e58f208be9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.175475 Jun 30 13:10:29.843263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 265/533] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:29 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:30.139187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d89ab8ac-abd6-4795-b446-742f80811478 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:30.140729 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d89ab8ac-abd6-4795-b446-742f80811478 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:30.152419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d89ab8ac-abd6-4795-b446-742f80811478 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:30.153285 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d89ab8ac-abd6-4795-b446-742f80811478 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:30.163173 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d89ab8ac-abd6-4795-b446-742f80811478 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:30.163626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d89ab8ac-abd6-4795-b446-742f80811478 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:30.310111 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d89ab8ac-abd6-4795-b446-742f80811478 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:30.317968 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d89ab8ac-abd6-4795-b446-742f80811478 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.185189 Jun 30 13:10:30.318581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 269/534] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:30 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:30.864672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:30.865553 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:30.873223 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:30.873652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:30.874482 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:30.874884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:31.011781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:31.020565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:31.022044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:31.023222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-683eeae6-4911-452b-9adb-7c4b9c7a9269 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.164617 Jun 30 13:10:31.023779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 266/535] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:30 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:31.340189 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8375f9e1-fe8b-498a-ad7b-3220820914ca tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:31.342022 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8375f9e1-fe8b-498a-ad7b-3220820914ca tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:31.352388 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8375f9e1-fe8b-498a-ad7b-3220820914ca tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:31.352827 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8375f9e1-fe8b-498a-ad7b-3220820914ca tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:31.353585 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8375f9e1-fe8b-498a-ad7b-3220820914ca tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:31.354008 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8375f9e1-fe8b-498a-ad7b-3220820914ca tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:31.487613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8375f9e1-fe8b-498a-ad7b-3220820914ca tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:31.495555 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8375f9e1-fe8b-498a-ad7b-3220820914ca tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.162517 Jun 30 13:10:31.496199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 270/536] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:31 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:32.043112 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:32.044497 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:32.052004 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:32.052876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:32.053649 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:32.054082 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:32.189995 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:32.200688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:32.203014 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:32.204498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5148efb1-9236-4bf4-b6c8-ef576a76e4f0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.165417 Jun 30 13:10:32.205475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 267/537] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:32 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:32.512309 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-11cedbb5-494f-4584-bd2d-e8c26d0cd42b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:32.513024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-11cedbb5-494f-4584-bd2d-e8c26d0cd42b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:32.519624 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11cedbb5-494f-4584-bd2d-e8c26d0cd42b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:32.520062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11cedbb5-494f-4584-bd2d-e8c26d0cd42b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:32.521031 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11cedbb5-494f-4584-bd2d-e8c26d0cd42b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:32.521626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-11cedbb5-494f-4584-bd2d-e8c26d0cd42b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:32.663717 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-11cedbb5-494f-4584-bd2d-e8c26d0cd42b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:32.672008 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-11cedbb5-494f-4584-bd2d-e8c26d0cd42b tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.163621 Jun 30 13:10:32.672847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 271/538] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:32 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:33.223877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:33.224755 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:33.231837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:33.232302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:33.233058 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:33.233474 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:33.373314 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:33.382029 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:33.383555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:33.384702 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7fbfc980-63d2-4d2e-95c3-ff09c4d5caf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.164916 Jun 30 13:10:33.385263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 268/539] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:33 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:33.692529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6f66cf9b-e8e7-4ca7-9964-231b9f2fea18 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:33.693174 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6f66cf9b-e8e7-4ca7-9964-231b9f2fea18 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:33.700851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f66cf9b-e8e7-4ca7-9964-231b9f2fea18 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:33.701291 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f66cf9b-e8e7-4ca7-9964-231b9f2fea18 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:33.702083 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f66cf9b-e8e7-4ca7-9964-231b9f2fea18 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:33.702548 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f66cf9b-e8e7-4ca7-9964-231b9f2fea18 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:33.840150 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6f66cf9b-e8e7-4ca7-9964-231b9f2fea18 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:33.847936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6f66cf9b-e8e7-4ca7-9964-231b9f2fea18 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.161960 Jun 30 13:10:33.848506 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 272/540] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:33 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:34.403524 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:34.404134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:34.410817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:34.411286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:34.412065 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:34.412604 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:34.549080 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:34.558676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:34.560158 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:34.561315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7f7c63f4-c755-4588-ade7-047c9d1d1935 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.161765 Jun 30 13:10:34.561882 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 269/541] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:34 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:34.865336 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-98a407da-bf74-4a8f-a679-205880448e66 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:34.865926 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-98a407da-bf74-4a8f-a679-205880448e66 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:34.872836 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98a407da-bf74-4a8f-a679-205880448e66 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:34.873267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98a407da-bf74-4a8f-a679-205880448e66 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:34.874017 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98a407da-bf74-4a8f-a679-205880448e66 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:34.874475 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-98a407da-bf74-4a8f-a679-205880448e66 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:35.015292 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-98a407da-bf74-4a8f-a679-205880448e66 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:35.023613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-98a407da-bf74-4a8f-a679-205880448e66 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.162361 Jun 30 13:10:35.024181 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 273/542] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:34 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:35.582883 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:35.583490 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:35.591200 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:35.591998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:35.592768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:35.593196 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:35.731731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:35.740293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:35.741746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:35.742948 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2a291221-c0d6-4065-b292-cde73522e8c9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.166553 Jun 30 13:10:35.743503 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 270/543] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:35 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:36.045649 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b4f2414a-a1e1-4a8f-bbab-44af69f1cbb5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:36.046604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b4f2414a-a1e1-4a8f-bbab-44af69f1cbb5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:36.055847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f2414a-a1e1-4a8f-bbab-44af69f1cbb5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:36.056282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f2414a-a1e1-4a8f-bbab-44af69f1cbb5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:36.057024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f2414a-a1e1-4a8f-bbab-44af69f1cbb5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:36.057442 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b4f2414a-a1e1-4a8f-bbab-44af69f1cbb5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:36.199596 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b4f2414a-a1e1-4a8f-bbab-44af69f1cbb5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:36.207188 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b4f2414a-a1e1-4a8f-bbab-44af69f1cbb5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.167982 Jun 30 13:10:36.207749 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 274/544] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:36 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:10:36.765336 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:36.766297 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:36.777203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:36.777929 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:36.779223 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:36.779933 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:36.912230 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:36.920929 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:36.922438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:36.923585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c718c2c2-a0eb-48e6-ab07-6a6604584b10 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.164788 Jun 30 13:10:36.924140 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 271/545] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:36 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:37.228946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2ddcfe94-921e-4e7e-a966-36c7fe1cf64d tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:37.229895 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2ddcfe94-921e-4e7e-a966-36c7fe1cf64d tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:37.241054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ddcfe94-921e-4e7e-a966-36c7fe1cf64d tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:37.241776 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ddcfe94-921e-4e7e-a966-36c7fe1cf64d tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:37.243070 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ddcfe94-921e-4e7e-a966-36c7fe1cf64d tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:37.243767 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2ddcfe94-921e-4e7e-a966-36c7fe1cf64d tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:37.382606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2ddcfe94-921e-4e7e-a966-36c7fe1cf64d tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:37.390132 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2ddcfe94-921e-4e7e-a966-36c7fe1cf64d tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.168054 Jun 30 13:10:37.390729 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 275/546] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:37 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:37.945993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:37.946823 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:37.955894 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:37.956483 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:37.957445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:37.958164 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:38.097885 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:38.107260 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:38.108758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:38.109915 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2a5f65b6-4504-4f7e-9bc1-bbf601f10170 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.170079 Jun 30 13:10:38.110500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 272/547] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:37 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:38.411424 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9292599d-f8df-4204-b403-13b09354a566 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:38.412339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9292599d-f8df-4204-b403-13b09354a566 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:38.423830 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292599d-f8df-4204-b403-13b09354a566 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:38.424562 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292599d-f8df-4204-b403-13b09354a566 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:38.425807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292599d-f8df-4204-b403-13b09354a566 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:38.426561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9292599d-f8df-4204-b403-13b09354a566 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:38.590436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9292599d-f8df-4204-b403-13b09354a566 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:38.598640 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9292599d-f8df-4204-b403-13b09354a566 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.193581 Jun 30 13:10:38.599185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 276/548] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:38 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:39.132936 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:39.133634 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:39.144951 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:39.145616 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:39.146845 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:39.147404 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:39.293664 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:39.302355 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:39.303894 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:39.305063 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-92a4a635-d0df-4c30-87b7-20fdf16edf36 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.178663 Jun 30 13:10:39.305613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 273/549] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:39 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:39.621534 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-38273be6-59f7-4aef-b859-0b271885671a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:39.622515 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-38273be6-59f7-4aef-b859-0b271885671a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:39.632992 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38273be6-59f7-4aef-b859-0b271885671a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:39.633423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38273be6-59f7-4aef-b859-0b271885671a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:39.634177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38273be6-59f7-4aef-b859-0b271885671a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:39.634631 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-38273be6-59f7-4aef-b859-0b271885671a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:39.774261 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-38273be6-59f7-4aef-b859-0b271885671a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:39.781864 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-38273be6-59f7-4aef-b859-0b271885671a tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.166742 Jun 30 13:10:39.782450 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 277/550] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:39 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:40.324099 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:40.324690 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:40.331179 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:40.331622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:40.332394 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:40.332813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:40.467344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:40.476149 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:40.477649 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:40.478840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-68646fb3-6ef8-4392-becf-d7eac0e4fdf7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.158732 Jun 30 13:10:40.479423 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 274/551] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:40 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:40.803381 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8344492e-52ca-4fea-877d-62c303326999 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:40.804536 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8344492e-52ca-4fea-877d-62c303326999 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:40.811497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8344492e-52ca-4fea-877d-62c303326999 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:40.811933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8344492e-52ca-4fea-877d-62c303326999 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:40.812687 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8344492e-52ca-4fea-877d-62c303326999 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:40.813143 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8344492e-52ca-4fea-877d-62c303326999 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:40.827982 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:40.949915 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8344492e-52ca-4fea-877d-62c303326999 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:40.957543 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8344492e-52ca-4fea-877d-62c303326999 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.160743 Jun 30 13:10:40.958106 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 278/552] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:40 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:41.498571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:41.499214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:41.506052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:41.506527 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:41.507263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:41.507703 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:41.641871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:41.655305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:41.657645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:41.659544 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-96fbdd7c-c0fc-42a8-9bcb-a259f8b43c25 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.164779 Jun 30 13:10:41.660435 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 275/553] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:41 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:41.978790 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9bbbe074-6e3a-4343-80d5-52eeb359b049 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:41.979885 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9bbbe074-6e3a-4343-80d5-52eeb359b049 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:41.991043 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbbe074-6e3a-4343-80d5-52eeb359b049 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:41.991762 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbbe074-6e3a-4343-80d5-52eeb359b049 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:41.993003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbbe074-6e3a-4343-80d5-52eeb359b049 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:41.993710 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bbbe074-6e3a-4343-80d5-52eeb359b049 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:42.146162 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9bbbe074-6e3a-4343-80d5-52eeb359b049 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:42.154448 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9bbbe074-6e3a-4343-80d5-52eeb359b049 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.182554 Jun 30 13:10:42.155012 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 279/554] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:41 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:42.683309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:42.684251 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:42.695457 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:42.696183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:42.697177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:42.697653 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:42.884176 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:42.892900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:42.894405 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:42.895542 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9b965906-5400-4f9d-aab0-fb1c4ba65a9f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.219129 Jun 30 13:10:42.896101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 276/555] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:42 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:43.175816 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-277a7650-154b-4e39-86c8-7bd073051c67 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:43.176926 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-277a7650-154b-4e39-86c8-7bd073051c67 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:43.188417 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-277a7650-154b-4e39-86c8-7bd073051c67 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:43.189151 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-277a7650-154b-4e39-86c8-7bd073051c67 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:43.190420 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-277a7650-154b-4e39-86c8-7bd073051c67 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:43.191147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-277a7650-154b-4e39-86c8-7bd073051c67 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:43.396703 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-277a7650-154b-4e39-86c8-7bd073051c67 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:43.404248 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-277a7650-154b-4e39-86c8-7bd073051c67 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.235086 Jun 30 13:10:43.404813 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 280/556] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:43 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:43.914628 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:43.915340 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:43.922194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:43.922675 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:43.923435 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:43.923844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:44.060344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:44.069169 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:44.070696 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:44.072645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b0070ead-24fe-4bd6-85da-87b37ddb6e12 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.161285 Jun 30 13:10:44.073195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 277/557] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:43 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:10:44.425309 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3cf5dfb0-a258-4b6d-a300-a4a4cf1f3ea1 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:44.426340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3cf5dfb0-a258-4b6d-a300-a4a4cf1f3ea1 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:44.434693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3cf5dfb0-a258-4b6d-a300-a4a4cf1f3ea1 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:44.435131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3cf5dfb0-a258-4b6d-a300-a4a4cf1f3ea1 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:44.435918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3cf5dfb0-a258-4b6d-a300-a4a4cf1f3ea1 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:44.436338 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3cf5dfb0-a258-4b6d-a300-a4a4cf1f3ea1 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:44.570512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3cf5dfb0-a258-4b6d-a300-a4a4cf1f3ea1 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:44.578675 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3cf5dfb0-a258-4b6d-a300-a4a4cf1f3ea1 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.159693 Jun 30 13:10:44.579138 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 281/558] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:44 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:45.093164 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:45.093789 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:45.101109 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:45.101570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:45.102355 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:45.102849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:45.245757 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:45.254605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:45.256120 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:45.257276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7dc20abd-b22b-461d-8e5d-68f66d41a589 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.168654 Jun 30 13:10:45.258066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 278/559] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:45 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:45.597085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ed5270b9-2bf2-470a-b397-9dcc48db7133 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:45.597803 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ed5270b9-2bf2-470a-b397-9dcc48db7133 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:45.605840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed5270b9-2bf2-470a-b397-9dcc48db7133 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:45.606330 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed5270b9-2bf2-470a-b397-9dcc48db7133 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:45.607104 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed5270b9-2bf2-470a-b397-9dcc48db7133 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:45.607536 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed5270b9-2bf2-470a-b397-9dcc48db7133 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:45.748394 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ed5270b9-2bf2-470a-b397-9dcc48db7133 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:45.756389 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ed5270b9-2bf2-470a-b397-9dcc48db7133 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.163950 Jun 30 13:10:45.756956 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 282/560] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:45 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:46.016013 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-eb54d03e-627c-482c-a795-505a39f73157 req-9d93564a-0ac0-4c5e-82b1-3b3462ec79fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9d9c42-cb9f-45f6-aee6-62abf9d927f0", "name": "network-vif-plugged", "status": "completed", "tag": "8b8cd4e2-00cb-44a6-9fd8-546136c1db73"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:46.024473 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-eb54d03e-627c-482c-a795-505a39f73157 req-9d93564a-0ac0-4c5e-82b1-3b3462ec79fc service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:46.024775 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-eb54d03e-627c-482c-a795-505a39f73157 req-9d93564a-0ac0-4c5e-82b1-3b3462ec79fc service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:46.037546 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-eb54d03e-627c-482c-a795-505a39f73157 req-9d93564a-0ac0-4c5e-82b1-3b3462ec79fc service nova] Creating event network-vif-plugged:8b8cd4e2-00cb-44a6-9fd8-546136c1db73 for instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 on hv-cinder-81268 Jun 30 13:10:46.043153 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-eb54d03e-627c-482c-a795-505a39f73157 req-9d93564a-0ac0-4c5e-82b1-3b3462ec79fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031038 Jun 30 13:10:46.043918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 279/561] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:10:46.280582 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:46.281562 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:46.291751 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:46.292180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:46.292966 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:46.293383 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:46.429247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:46.438658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:46.440147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:46.441308 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-86b7fa6f-38fa-4cf6-823d-211bbd759f14 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.167728 Jun 30 13:10:46.441859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 283/562] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:46 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:46.777467 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4f5abf42-15ae-42d1-95a3-0643ef38701c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:46.778269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4f5abf42-15ae-42d1-95a3-0643ef38701c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:46.786620 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f5abf42-15ae-42d1-95a3-0643ef38701c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:46.787135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f5abf42-15ae-42d1-95a3-0643ef38701c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:46.788010 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f5abf42-15ae-42d1-95a3-0643ef38701c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:46.788510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4f5abf42-15ae-42d1-95a3-0643ef38701c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:46.943726 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4f5abf42-15ae-42d1-95a3-0643ef38701c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:46.951469 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4f5abf42-15ae-42d1-95a3-0643ef38701c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.180359 Jun 30 13:10:46.952002 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 280/563] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:46 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:47.464202 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:47.464976 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:47.472570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:47.473026 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:47.473812 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:47.474250 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:47.935728 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:47.944470 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:47.945954 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:47.947147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7f8e4e7c-41c5-41ea-9de5-c8cd6d277ba4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.489720 Jun 30 13:10:47.947949 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 284/564] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:47 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:47.968812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4074c308-7213-4c7f-9856-914c344d67a6 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:47.969422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4074c308-7213-4c7f-9856-914c344d67a6 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:47.976062 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4074c308-7213-4c7f-9856-914c344d67a6 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:47.976500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4074c308-7213-4c7f-9856-914c344d67a6 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:47.977259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4074c308-7213-4c7f-9856-914c344d67a6 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:47.977682 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4074c308-7213-4c7f-9856-914c344d67a6 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:47.981838 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:48.110287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4074c308-7213-4c7f-9856-914c344d67a6 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:48.118021 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4074c308-7213-4c7f-9856-914c344d67a6 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.153498 Jun 30 13:10:48.118620 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 281/565] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:47 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:48.971492 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:48.972027 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:48.978284 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:48.978756 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:48.979494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:48.980072 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:49.114095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:49.122889 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:49.124388 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:49.125539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a92065de-a7f9-4afb-a826-4c0fcea73e3b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.163079 Jun 30 13:10:49.126101 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 285/566] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:48 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:49.135324 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e008f551-f616-4896-b1e5-a5d6a3608741 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:49.136139 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e008f551-f616-4896-b1e5-a5d6a3608741 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:49.143194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e008f551-f616-4896-b1e5-a5d6a3608741 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:49.143629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e008f551-f616-4896-b1e5-a5d6a3608741 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:49.144386 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e008f551-f616-4896-b1e5-a5d6a3608741 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:49.144808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e008f551-f616-4896-b1e5-a5d6a3608741 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:49.286995 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e008f551-f616-4896-b1e5-a5d6a3608741 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:49.295131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e008f551-f616-4896-b1e5-a5d6a3608741 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1319 microversion: 2.1 time: 0.163709 Jun 30 13:10:49.295697 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 282/567] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:49 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:50.148218 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:50.149162 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:50.157100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:50.157535 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:50.158294 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:50.158773 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:50.304316 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:50.312778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-27a4b3f5-15dd-4c1d-b7d1-77268d433ddd tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:50.313465 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-27a4b3f5-15dd-4c1d-b7d1-77268d433ddd tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:50.313876 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:50.315476 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:50.316630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-890b1ef3-4a6b-46d6-9241-97c7cbd52b2f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.175201 Jun 30 13:10:50.317187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 286/568] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:50 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:50.330078 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-27a4b3f5-15dd-4c1d-b7d1-77268d433ddd tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:50.330536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-27a4b3f5-15dd-4c1d-b7d1-77268d433ddd tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:50.332205 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-27a4b3f5-15dd-4c1d-b7d1-77268d433ddd tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:50.332205 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-27a4b3f5-15dd-4c1d-b7d1-77268d433ddd tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:50.371953 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-3d4c388e-2117-498d-af92-1c6365277376 req-2256da66-5964-4e56-b7af-ea7e8b274f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2c8af5-6d65-4177-9434-65a1d15813c9", "name": "network-vif-plugged", "status": "completed", "tag": "c11821df-b3b9-4d4d-9e5c-85ddf105efeb"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:50.380727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3d4c388e-2117-498d-af92-1c6365277376 req-2256da66-5964-4e56-b7af-ea7e8b274f97 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:50.381236 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-3d4c388e-2117-498d-af92-1c6365277376 req-2256da66-5964-4e56-b7af-ea7e8b274f97 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:50.392763 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-3d4c388e-2117-498d-af92-1c6365277376 req-2256da66-5964-4e56-b7af-ea7e8b274f97 service nova] Creating event network-vif-plugged:c11821df-b3b9-4d4d-9e5c-85ddf105efeb for instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 on hv-cinder-81268 Jun 30 13:10:50.398096 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-3d4c388e-2117-498d-af92-1c6365277376 req-2256da66-5964-4e56-b7af-ea7e8b274f97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030375 Jun 30 13:10:50.399271 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 287/569] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:10:50.470910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-27a4b3f5-15dd-4c1d-b7d1-77268d433ddd tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:50.478495 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-27a4b3f5-15dd-4c1d-b7d1-77268d433ddd tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1508 microversion: 2.1 time: 0.169543 Jun 30 13:10:50.479043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 283/570] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:10:50 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:10:50.495904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-54dc733b-ab5a-4595-8789-4574b6aff1de tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9aa38c9-6532-45a5-ab4a-6db36049e113", "device": "/dev/sdb"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:10:50.497090 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-54dc733b-ab5a-4595-8789-4574b6aff1de tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:50.503782 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54dc733b-ab5a-4595-8789-4574b6aff1de tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:50.504218 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54dc733b-ab5a-4595-8789-4574b6aff1de tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:50.504985 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54dc733b-ab5a-4595-8789-4574b6aff1de tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:50.505403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54dc733b-ab5a-4595-8789-4574b6aff1de tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:51.339332 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:51.340076 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:51.348206 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:51.348693 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:51.349539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:51.350013 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:51.489096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:51.499877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:51.502052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:51.503573 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-16a7d446-1464-44f7-8720-915699abce55 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.171134 Jun 30 13:10:51.504705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 284/571] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:51 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:51.603136 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-54dc733b-ab5a-4595-8789-4574b6aff1de tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "POST /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111498 Jun 30 13:10:51.604205 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 288/572] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:10:50 2022] POST /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0/os-volume_attachments => generated 194 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:10:52.523101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:52.523758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:52.531074 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:52.531509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:52.532257 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:52.532673 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:52.668552 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:52.677981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:52.679510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:52.680817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d19bab3f-8cdb-4fd8-9ec2-a764a6fcb0ba tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.161737 Jun 30 13:10:52.681371 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 285/573] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:52 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:53.703191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:53.703860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:53.705836 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=54 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:53.713016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:53.713440 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:53.714227 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:53.714675 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:53.851858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:53.860550 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:53.862038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:53.863254 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1ee8732d-5b3d-4c34-853d-93c288ecc502 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.167090 Jun 30 13:10:53.863814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 289/574] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:53 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:54.886153 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:54.887189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:54.899320 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:54.900045 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:54.901279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:54.901976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:55.033783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:55.046051 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:55.047570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:55.048746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-de4c392b-c96b-42bd-9b82-0ccbc130fd74 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1807 microversion: 2.20 time: 0.169044 Jun 30 13:10:55.049260 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 286/575] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:54 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:10:56.068470 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:10:56.069015 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:10:56.076699 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:56.077266 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:56.078172 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:10:56.078684 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:10:56.217341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:56.226491 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:56.227969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:10:56.229110 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ac345e2a-3c32-4993-996e-e052433dd539 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1794 microversion: 2.20 time: 0.164709 Jun 30 13:10:56.229655 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 290/576] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:10:56 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1794 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:11:03.135131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:11:03.135744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Thu Jun 30 13:11:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:11:17.315753 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f3537449-acd2-4314-893f-5feab64379d9 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:17.316447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f3537449-acd2-4314-893f-5feab64379d9 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:17.319270 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=49 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:17.320049 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=35 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:17.329369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f3537449-acd2-4314-893f-5feab64379d9 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:17.330088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f3537449-acd2-4314-893f-5feab64379d9 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:17.331347 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f3537449-acd2-4314-893f-5feab64379d9 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:17.331984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f3537449-acd2-4314-893f-5feab64379d9 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:17.484668 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-f3537449-acd2-4314-893f-5feab64379d9 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lazy-loading 'services' on Instance uuid 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:11:17.631770 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f3537449-acd2-4314-893f-5feab64379d9 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0/os-volume_attachments/a9aa38c9-6532-45a5-ab4a-6db36049e113" status: 202 len: 0 microversion: 2.1 time: 0.319796 Jun 30 13:11:17.632486 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 287/577] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:11:17 2022] DELETE /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0/os-volume_attachments/a9aa38c9-6532-45a5-ab4a-6db36049e113 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:11:19.812056 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d35a1c9c-83a8-49f5-b8c6-2a759dc9387c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:19.812583 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d35a1c9c-83a8-49f5-b8c6-2a759dc9387c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:19.815166 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:19.815804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:19.821618 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d35a1c9c-83a8-49f5-b8c6-2a759dc9387c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:19.822051 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d35a1c9c-83a8-49f5-b8c6-2a759dc9387c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:19.822828 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d35a1c9c-83a8-49f5-b8c6-2a759dc9387c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:19.823249 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d35a1c9c-83a8-49f5-b8c6-2a759dc9387c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:19.851705 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d35a1c9c-83a8-49f5-b8c6-2a759dc9387c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:11:19.938566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d35a1c9c-83a8-49f5-b8c6-2a759dc9387c tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 204 len: 0 microversion: 2.1 time: 0.130136 Jun 30 13:11:19.939154 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 291/578] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:11:19 2022] DELETE /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:11:19.948515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a8548bad-67bf-45a9-a862-2f8d21d97fd7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:19.949224 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a8548bad-67bf-45a9-a862-2f8d21d97fd7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:19.956279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a8548bad-67bf-45a9-a862-2f8d21d97fd7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:19.956715 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a8548bad-67bf-45a9-a862-2f8d21d97fd7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:19.957471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a8548bad-67bf-45a9-a862-2f8d21d97fd7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:19.957932 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a8548bad-67bf-45a9-a862-2f8d21d97fd7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:20.094449 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a8548bad-67bf-45a9-a862-2f8d21d97fd7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:20.102521 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a8548bad-67bf-45a9-a862-2f8d21d97fd7 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1514 microversion: 2.1 time: 0.158782 Jun 30 13:11:20.103079 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 288/579] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:19 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:11:21.125116 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-427763ca-f8e3-4e26-b11a-653476abc024 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:21.126278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-427763ca-f8e3-4e26-b11a-653476abc024 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:21.137220 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-427763ca-f8e3-4e26-b11a-653476abc024 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:21.137692 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-427763ca-f8e3-4e26-b11a-653476abc024 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:21.138452 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-427763ca-f8e3-4e26-b11a-653476abc024 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:21.138924 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-427763ca-f8e3-4e26-b11a-653476abc024 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:21.281881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-427763ca-f8e3-4e26-b11a-653476abc024 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:21.289687 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-427763ca-f8e3-4e26-b11a-653476abc024 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1514 microversion: 2.1 time: 0.171741 Jun 30 13:11:21.290253 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 292/580] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:21 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:22.307686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6543adf0-b768-40fb-a982-dfeb66c33bd5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:22.308284 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6543adf0-b768-40fb-a982-dfeb66c33bd5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:22.315314 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6543adf0-b768-40fb-a982-dfeb66c33bd5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:22.315747 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6543adf0-b768-40fb-a982-dfeb66c33bd5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:22.316486 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6543adf0-b768-40fb-a982-dfeb66c33bd5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:22.316900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6543adf0-b768-40fb-a982-dfeb66c33bd5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:22.462536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6543adf0-b768-40fb-a982-dfeb66c33bd5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:22.474552 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6543adf0-b768-40fb-a982-dfeb66c33bd5 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1514 microversion: 2.1 time: 0.170485 Jun 30 13:11:22.475335 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 289/581] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:22 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:23.274090 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-c9006301-0139-4544-b78f-26864345fa73 req-88245528-a3bc-4062-9ccd-319f92571cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9d9c42-cb9f-45f6-aee6-62abf9d927f0", "name": "network-vif-deleted", "tag": "8b8cd4e2-00cb-44a6-9fd8-546136c1db73"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:11:23.282855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c9006301-0139-4544-b78f-26864345fa73 req-88245528-a3bc-4062-9ccd-319f92571cbb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:23.283372 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c9006301-0139-4544-b78f-26864345fa73 req-88245528-a3bc-4062-9ccd-319f92571cbb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:23.296117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-c9006301-0139-4544-b78f-26864345fa73 req-88245528-a3bc-4062-9ccd-319f92571cbb service nova] Creating event network-vif-deleted:8b8cd4e2-00cb-44a6-9fd8-546136c1db73 for instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 on hv-cinder-81268 Jun 30 13:11:23.301278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-c9006301-0139-4544-b78f-26864345fa73 req-88245528-a3bc-4062-9ccd-319f92571cbb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093940 Jun 30 13:11:23.302159 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 293/582] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:11:23.495562 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:23.496712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:23.506511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:23.507180 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:23.508320 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:23.509010 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:23.540470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:23.540871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:23.541334 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lazy-loading 'fault' on Instance uuid 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:11:23.584710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79388c8109554a82b6336fd8c803005f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b3073c2c6f4f479aae8d37cccc7ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:23.592543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5411bf96-7b35-4ba0-ba88-7887686bdfad tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 200 len: 1309 microversion: 2.1 time: 0.102781 Jun 30 13:11:23.593096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 290/583] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:23 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:24.615555 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:24.616742 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] [instance: 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:24.625330 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:24.625768 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:24.626639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:24.627067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:24.640657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] HTTP exception thrown: Instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 could not be found. Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Request method failure captured: Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 HTTP/1.1 Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaBENkx_eZkgXem3dM9-QBtKzgVhHt8_Lqxq8P1IN7U_LPgkIXYO-ot-Fp_XjM0kssB_8tP1JHNOPD5gPOj51Y10VLuFuphb5i0_KsuAQJDCjye9ddvx8maDR7oq77_7YRsM58Fx58dB2Dzb_tnRdsv9el6QC5pHWpJGMYL69vYOFdE Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 22b3073c2c6f4f479aae8d37cccc7ae8 Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesSnapshotTestJSON-882730788 Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:11:24.642251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/22b3073c2c6f4f479aae8d37cccc7ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/22b3073c2c6f4f479aae8d37cccc7ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_22b3073c2c6f4f479aae8d37cccc7ae8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/22b3073c2c6f4f479aae8d37cccc7ae8"}]}] Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesSnapshotTestJSON-882730788 Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 22b3073c2c6f4f479aae8d37cccc7ae8 Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-882730788 Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesSnapshotTestJSON-882730788-project Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 79388c8109554a82b6336fd8c803005f Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesSnapshotTestJSON-882730788-project Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 could not be found. Jun 30 13:11:24.643724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '2a9d9c42-cb9f-45f6-aee6-62abf9d927f0'} Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 could not be found. Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:11:24.644566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 could not be found. Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 could not be found. Jun 30 13:11:24.646011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:11:24.647981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] Returning 404 to user: Instance 2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:11:24.647981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-46859b27-d393-4f00-81a4-bac95dc49757 tempest-VolumesSnapshotTestJSON-882730788 tempest-VolumesSnapshotTestJSON-882730788-project] 10.222.0.49 "GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0" status: 404 len: 111 microversion: 2.1 time: 0.035919 Jun 30 13:11:24.647981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 294/584] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:24 2022] GET /compute/v2.1/servers/2a9d9c42-cb9f-45f6-aee6-62abf9d927f0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:11:44.372119 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7f1ececa-7475-4d53-ba0a-2e17bec50a8e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11e92339-2224-4deb-a806-a813eff4d326"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:11:44.373840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7f1ececa-7475-4d53-ba0a-2e17bec50a8e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:44.377430 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=10 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:44.378121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:44.384091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7f1ececa-7475-4d53-ba0a-2e17bec50a8e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:44.384533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7f1ececa-7475-4d53-ba0a-2e17bec50a8e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:44.385298 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7f1ececa-7475-4d53-ba0a-2e17bec50a8e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:44.385725 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7f1ececa-7475-4d53-ba0a-2e17bec50a8e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:44.686805 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7f1ececa-7475-4d53-ba0a-2e17bec50a8e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319009 Jun 30 13:11:44.687441 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 291/585] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:11:44 2022] POST /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:11:52.250260 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1decfd0-e118-4dce-a518-ea7b9c7acf5f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:11:52.251295 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1decfd0-e118-4dce-a518-ea7b9c7acf5f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:52.253808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:52.255095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:52.260417 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1decfd0-e118-4dce-a518-ea7b9c7acf5f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:52.261030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1decfd0-e118-4dce-a518-ea7b9c7acf5f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:52.261875 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1decfd0-e118-4dce-a518-ea7b9c7acf5f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:52.262189 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1decfd0-e118-4dce-a518-ea7b9c7acf5f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:52.295137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-b1decfd0-e118-4dce-a518-ea7b9c7acf5f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lazy-loading 'flavor' on Instance uuid 9d58b08a-c2ee-4f45-90c0-400b9e677939 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:11:52.441720 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1decfd0-e118-4dce-a518-ea7b9c7acf5f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/action" status: 200 len: 32 microversion: 2.1 time: 0.195584 Jun 30 13:11:52.442567 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 295/586] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:11:52 2022] POST /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:11:52.454855 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-475d4db7-0c7d-4799-bee1-7669af6954a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:52.456184 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-475d4db7-0c7d-4799-bee1-7669af6954a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:52.465181 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-475d4db7-0c7d-4799-bee1-7669af6954a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:52.466029 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-475d4db7-0c7d-4799-bee1-7669af6954a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:52.472839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-475d4db7-0c7d-4799-bee1-7669af6954a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:52.473951 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-475d4db7-0c7d-4799-bee1-7669af6954a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:52.962843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-475d4db7-0c7d-4799-bee1-7669af6954a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:52.972903 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-475d4db7-0c7d-4799-bee1-7669af6954a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.523350 Jun 30 13:11:52.973591 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 292/587] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:52 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:53.992885 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-836a46bb-49e5-4589-a100-f217dad3da27 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:53.993667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-836a46bb-49e5-4589-a100-f217dad3da27 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:54.002761 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-836a46bb-49e5-4589-a100-f217dad3da27 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:54.003479 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-836a46bb-49e5-4589-a100-f217dad3da27 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:54.005012 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-836a46bb-49e5-4589-a100-f217dad3da27 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:54.005645 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-836a46bb-49e5-4589-a100-f217dad3da27 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:54.140095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-836a46bb-49e5-4589-a100-f217dad3da27 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:54.148705 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-836a46bb-49e5-4589-a100-f217dad3da27 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.160822 Jun 30 13:11:54.149281 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 296/588] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:53 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:55.175803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-eec1d04f-d3fb-4ecb-a227-c93f509a7d4d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:55.176750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-eec1d04f-d3fb-4ecb-a227-c93f509a7d4d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:55.184242 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eec1d04f-d3fb-4ecb-a227-c93f509a7d4d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:55.184695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eec1d04f-d3fb-4ecb-a227-c93f509a7d4d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:55.185452 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eec1d04f-d3fb-4ecb-a227-c93f509a7d4d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:55.185880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eec1d04f-d3fb-4ecb-a227-c93f509a7d4d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:55.323825 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eec1d04f-d3fb-4ecb-a227-c93f509a7d4d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:55.332472 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-eec1d04f-d3fb-4ecb-a227-c93f509a7d4d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.163179 Jun 30 13:11:55.333043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 293/589] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:55 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:56.354579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e439aa3e-83c2-4242-9958-00e5026643de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:56.355556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e439aa3e-83c2-4242-9958-00e5026643de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:56.366841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e439aa3e-83c2-4242-9958-00e5026643de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:56.367565 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e439aa3e-83c2-4242-9958-00e5026643de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:56.368861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e439aa3e-83c2-4242-9958-00e5026643de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:56.369552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e439aa3e-83c2-4242-9958-00e5026643de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:56.512120 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e439aa3e-83c2-4242-9958-00e5026643de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:56.525771 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e439aa3e-83c2-4242-9958-00e5026643de tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.177554 Jun 30 13:11:56.526420 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 297/590] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:56 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:57.552832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3b75645d-5067-4974-9ace-e7c80051d51e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:57.554549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3b75645d-5067-4974-9ace-e7c80051d51e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:57.564696 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3b75645d-5067-4974-9ace-e7c80051d51e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:57.565416 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3b75645d-5067-4974-9ace-e7c80051d51e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:57.566718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3b75645d-5067-4974-9ace-e7c80051d51e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:57.567418 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3b75645d-5067-4974-9ace-e7c80051d51e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:57.721026 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3b75645d-5067-4974-9ace-e7c80051d51e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:57.730796 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3b75645d-5067-4974-9ace-e7c80051d51e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.184583 Jun 30 13:11:57.731362 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 294/591] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:57 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:58.752409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16ac83c2-d51e-4d07-bfe5-01b7708459b5 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:58.753327 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16ac83c2-d51e-4d07-bfe5-01b7708459b5 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:58.764447 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16ac83c2-d51e-4d07-bfe5-01b7708459b5 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:58.765170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16ac83c2-d51e-4d07-bfe5-01b7708459b5 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:58.766412 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16ac83c2-d51e-4d07-bfe5-01b7708459b5 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:58.767133 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16ac83c2-d51e-4d07-bfe5-01b7708459b5 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:58.903848 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16ac83c2-d51e-4d07-bfe5-01b7708459b5 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:11:58.912353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16ac83c2-d51e-4d07-bfe5-01b7708459b5 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.166510 Jun 30 13:11:58.913175 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 298/592] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:58 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:11:59.934475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-460adfa1-c163-439d-ba51-b37d87511777 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:11:59.935487 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-460adfa1-c163-439d-ba51-b37d87511777 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:11:59.945904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-460adfa1-c163-439d-ba51-b37d87511777 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:59.946351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-460adfa1-c163-439d-ba51-b37d87511777 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:11:59.947120 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-460adfa1-c163-439d-ba51-b37d87511777 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:11:59.947541 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-460adfa1-c163-439d-ba51-b37d87511777 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:00.084804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-460adfa1-c163-439d-ba51-b37d87511777 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:00.095429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-460adfa1-c163-439d-ba51-b37d87511777 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.167696 Jun 30 13:12:00.095986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 295/593] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:11:59 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:01.116802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ba8ce959-79f4-4263-ac2b-510fe9feca11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:01.117375 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ba8ce959-79f4-4263-ac2b-510fe9feca11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:01.124635 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba8ce959-79f4-4263-ac2b-510fe9feca11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:01.125095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba8ce959-79f4-4263-ac2b-510fe9feca11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:01.125877 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba8ce959-79f4-4263-ac2b-510fe9feca11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:01.126351 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ba8ce959-79f4-4263-ac2b-510fe9feca11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:01.274682 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ba8ce959-79f4-4263-ac2b-510fe9feca11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:01.282887 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ba8ce959-79f4-4263-ac2b-510fe9feca11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.172443 Jun 30 13:12:01.283455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 299/594] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:01 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:02.301113 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-67ac22b1-ef39-4a93-9192-c242bf0ba3ee tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:02.301715 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-67ac22b1-ef39-4a93-9192-c242bf0ba3ee tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:02.309070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67ac22b1-ef39-4a93-9192-c242bf0ba3ee tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:02.309511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67ac22b1-ef39-4a93-9192-c242bf0ba3ee tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:02.310272 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67ac22b1-ef39-4a93-9192-c242bf0ba3ee tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:02.310726 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67ac22b1-ef39-4a93-9192-c242bf0ba3ee tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:02.448213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-67ac22b1-ef39-4a93-9192-c242bf0ba3ee tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:02.456382 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-67ac22b1-ef39-4a93-9192-c242bf0ba3ee tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.159193 Jun 30 13:12:02.456920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 296/595] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:02 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:02.589837 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41bda10e-739b-41bf-ad45-8b7b110009f3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:02.590384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-41bda10e-739b-41bf-ad45-8b7b110009f3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:02.597296 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bda10e-739b-41bf-ad45-8b7b110009f3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:02.597824 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bda10e-739b-41bf-ad45-8b7b110009f3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:02.598665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bda10e-739b-41bf-ad45-8b7b110009f3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:02.599073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41bda10e-739b-41bf-ad45-8b7b110009f3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:02.691453 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-41bda10e-739b-41bf-ad45-8b7b110009f3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lazy-loading 'services' on Instance uuid bfaf5f03-a265-481f-81c5-2f4432079c41 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:12:02.767275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41bda10e-739b-41bf-ad45-8b7b110009f3 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/os-volume_attachments/60ddd9f7-9575-4160-ae1e-e99bfeaab0ae" status: 202 len: 0 microversion: 2.1 time: 0.411696 Jun 30 13:12:02.767763 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 300/596] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:12:02 2022] DELETE /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/os-volume_attachments/60ddd9f7-9575-4160-ae1e-e99bfeaab0ae => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:12:03.476561 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bb809cb0-08f4-40b9-9534-5488b10dfb2f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:03.477161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bb809cb0-08f4-40b9-9534-5488b10dfb2f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:03.484258 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bb809cb0-08f4-40b9-9534-5488b10dfb2f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:03.484693 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bb809cb0-08f4-40b9-9534-5488b10dfb2f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:03.485447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bb809cb0-08f4-40b9-9534-5488b10dfb2f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:03.485868 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bb809cb0-08f4-40b9-9534-5488b10dfb2f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:03.622936 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bb809cb0-08f4-40b9-9534-5488b10dfb2f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:03.631153 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bb809cb0-08f4-40b9-9534-5488b10dfb2f tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.159877 Jun 30 13:12:03.631773 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 297/597] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:03 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:04.654970 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fc77c3e7-5984-4dd6-9aa3-b43193ee5414 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:04.656100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fc77c3e7-5984-4dd6-9aa3-b43193ee5414 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:04.666944 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc77c3e7-5984-4dd6-9aa3-b43193ee5414 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:04.667670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc77c3e7-5984-4dd6-9aa3-b43193ee5414 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:04.668902 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc77c3e7-5984-4dd6-9aa3-b43193ee5414 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:04.669594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fc77c3e7-5984-4dd6-9aa3-b43193ee5414 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:04.810758 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fc77c3e7-5984-4dd6-9aa3-b43193ee5414 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:04.821597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fc77c3e7-5984-4dd6-9aa3-b43193ee5414 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.174612 Jun 30 13:12:04.822135 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 301/598] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:04 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:04.951938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f800bd17-63eb-4d87-afef-17c7ff122a00 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:04.958936 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f800bd17-63eb-4d87-afef-17c7ff122a00 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:04.959379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f800bd17-63eb-4d87-afef-17c7ff122a00 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:05.018724 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f800bd17-63eb-4d87-afef-17c7ff122a00 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Going to try to stop instance {{(pid=117826) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 13:12:05.070081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f800bd17-63eb-4d87-afef-17c7ff122a00 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/action" status: 202 len: 0 microversion: 2.1 time: 0.121777 Jun 30 13:12:05.070800 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 298/599] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:12:04 2022] POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:12:05.078904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-734f6692-b721-442b-9ba1-bb0bdfefd4cd tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:05.079507 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-734f6692-b721-442b-9ba1-bb0bdfefd4cd tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:05.086487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f6692-b721-442b-9ba1-bb0bdfefd4cd tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:05.086965 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f6692-b721-442b-9ba1-bb0bdfefd4cd tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:05.087780 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f6692-b721-442b-9ba1-bb0bdfefd4cd tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:05.088204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-734f6692-b721-442b-9ba1-bb0bdfefd4cd tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:05.224054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-734f6692-b721-442b-9ba1-bb0bdfefd4cd tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:05.232051 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-734f6692-b721-442b-9ba1-bb0bdfefd4cd tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.156955 Jun 30 13:12:05.232618 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 302/600] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:05 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:05.845108 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c1772763-9997-4bbf-9c20-3c35da7cb1a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:05.846234 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c1772763-9997-4bbf-9c20-3c35da7cb1a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:05.854732 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1772763-9997-4bbf-9c20-3c35da7cb1a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:05.855169 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1772763-9997-4bbf-9c20-3c35da7cb1a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:05.855931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1772763-9997-4bbf-9c20-3c35da7cb1a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:05.856356 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1772763-9997-4bbf-9c20-3c35da7cb1a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:05.998518 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c1772763-9997-4bbf-9c20-3c35da7cb1a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:06.009984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c1772763-9997-4bbf-9c20-3c35da7cb1a9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.172451 Jun 30 13:12:06.010684 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 299/601] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:05 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:06.250288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b3f04542-19ed-4342-886a-80d18b324e6c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:06.250911 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b3f04542-19ed-4342-886a-80d18b324e6c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:06.258340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3f04542-19ed-4342-886a-80d18b324e6c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:06.258757 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3f04542-19ed-4342-886a-80d18b324e6c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:06.259637 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3f04542-19ed-4342-886a-80d18b324e6c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:06.260053 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b3f04542-19ed-4342-886a-80d18b324e6c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:06.393640 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b3f04542-19ed-4342-886a-80d18b324e6c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:06.401813 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b3f04542-19ed-4342-886a-80d18b324e6c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.155461 Jun 30 13:12:06.402411 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 303/602] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:06 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:07.035645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-53d51206-7d0d-4043-b34a-c2a2d3e7583b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:07.036603 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-53d51206-7d0d-4043-b34a-c2a2d3e7583b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:07.047907 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-53d51206-7d0d-4043-b34a-c2a2d3e7583b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:07.048625 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-53d51206-7d0d-4043-b34a-c2a2d3e7583b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:07.049904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-53d51206-7d0d-4043-b34a-c2a2d3e7583b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:07.050665 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-53d51206-7d0d-4043-b34a-c2a2d3e7583b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:07.186792 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-53d51206-7d0d-4043-b34a-c2a2d3e7583b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:07.195539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-53d51206-7d0d-4043-b34a-c2a2d3e7583b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.166396 Jun 30 13:12:07.196103 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 300/603] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:07 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:07.422696 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-372b6d34-8cf9-47f6-9e95-a580025125fe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:07.423693 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-372b6d34-8cf9-47f6-9e95-a580025125fe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:07.434882 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-372b6d34-8cf9-47f6-9e95-a580025125fe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:07.435611 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-372b6d34-8cf9-47f6-9e95-a580025125fe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:07.436844 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-372b6d34-8cf9-47f6-9e95-a580025125fe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:07.437560 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-372b6d34-8cf9-47f6-9e95-a580025125fe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:07.585293 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-372b6d34-8cf9-47f6-9e95-a580025125fe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:07.593679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-372b6d34-8cf9-47f6-9e95-a580025125fe tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.177500 Jun 30 13:12:07.594247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 304/604] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:07 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:08.217158 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8ce06f94-c2e8-4440-8dfb-fc4a608ad0a7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:08.218510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8ce06f94-c2e8-4440-8dfb-fc4a608ad0a7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:08.228260 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8ce06f94-c2e8-4440-8dfb-fc4a608ad0a7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:08.228698 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8ce06f94-c2e8-4440-8dfb-fc4a608ad0a7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:08.229454 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8ce06f94-c2e8-4440-8dfb-fc4a608ad0a7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:08.229900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8ce06f94-c2e8-4440-8dfb-fc4a608ad0a7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:08.361841 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8ce06f94-c2e8-4440-8dfb-fc4a608ad0a7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:08.370209 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8ce06f94-c2e8-4440-8dfb-fc4a608ad0a7 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.159530 Jun 30 13:12:08.370787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 301/605] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:08 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:08.615245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9f8214af-2155-422e-83b9-624a024fb8e2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:08.616196 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9f8214af-2155-422e-83b9-624a024fb8e2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:08.623500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8214af-2155-422e-83b9-624a024fb8e2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:08.623942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8214af-2155-422e-83b9-624a024fb8e2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:08.624695 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8214af-2155-422e-83b9-624a024fb8e2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:08.625119 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f8214af-2155-422e-83b9-624a024fb8e2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:08.767146 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9f8214af-2155-422e-83b9-624a024fb8e2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:08.778969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9f8214af-2155-422e-83b9-624a024fb8e2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.170008 Jun 30 13:12:08.779719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 305/606] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:08 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:09.395526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e3656b7c-b2aa-4f82-82f5-2b61bf117e6b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:09.396462 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e3656b7c-b2aa-4f82-82f5-2b61bf117e6b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:09.407500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e3656b7c-b2aa-4f82-82f5-2b61bf117e6b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:09.408218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e3656b7c-b2aa-4f82-82f5-2b61bf117e6b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:09.409452 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e3656b7c-b2aa-4f82-82f5-2b61bf117e6b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:09.410150 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e3656b7c-b2aa-4f82-82f5-2b61bf117e6b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:09.564271 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e3656b7c-b2aa-4f82-82f5-2b61bf117e6b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:09.574667 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e3656b7c-b2aa-4f82-82f5-2b61bf117e6b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.185642 Jun 30 13:12:09.575233 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 302/607] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:09 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:09.800945 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c842b631-4d73-4a6b-b751-bd855a587d77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:09.801826 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c842b631-4d73-4a6b-b751-bd855a587d77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:09.809400 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c842b631-4d73-4a6b-b751-bd855a587d77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:09.809835 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c842b631-4d73-4a6b-b751-bd855a587d77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:09.810613 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c842b631-4d73-4a6b-b751-bd855a587d77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:09.811033 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c842b631-4d73-4a6b-b751-bd855a587d77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:09.952234 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c842b631-4d73-4a6b-b751-bd855a587d77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:09.960422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c842b631-4d73-4a6b-b751-bd855a587d77 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.166437 Jun 30 13:12:09.960984 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 306/608] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:09 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:10.596963 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8633fc8d-c04a-4e0c-a3b3-ba2da087a7f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:10.597813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8633fc8d-c04a-4e0c-a3b3-ba2da087a7f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:10.608994 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8633fc8d-c04a-4e0c-a3b3-ba2da087a7f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:10.609770 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8633fc8d-c04a-4e0c-a3b3-ba2da087a7f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:10.611078 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8633fc8d-c04a-4e0c-a3b3-ba2da087a7f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:10.611783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8633fc8d-c04a-4e0c-a3b3-ba2da087a7f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:10.745489 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8633fc8d-c04a-4e0c-a3b3-ba2da087a7f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:10.753884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8633fc8d-c04a-4e0c-a3b3-ba2da087a7f8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.163901 Jun 30 13:12:10.754483 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 303/609] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:10 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:10.982636 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-03edc51b-6ad1-4f0b-9518-dd1c008d7842 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:10.983556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-03edc51b-6ad1-4f0b-9518-dd1c008d7842 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:10.994989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03edc51b-6ad1-4f0b-9518-dd1c008d7842 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:10.995749 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03edc51b-6ad1-4f0b-9518-dd1c008d7842 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:10.996999 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03edc51b-6ad1-4f0b-9518-dd1c008d7842 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:10.997720 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03edc51b-6ad1-4f0b-9518-dd1c008d7842 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:11.144035 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-03edc51b-6ad1-4f0b-9518-dd1c008d7842 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:11.152137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-03edc51b-6ad1-4f0b-9518-dd1c008d7842 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.176511 Jun 30 13:12:11.152727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 307/610] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:10 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:11.776186 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-35642c12-ba61-444a-b04a-f1bd8cf34d62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:11.777114 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-35642c12-ba61-444a-b04a-f1bd8cf34d62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:11.788022 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-35642c12-ba61-444a-b04a-f1bd8cf34d62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:11.788741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-35642c12-ba61-444a-b04a-f1bd8cf34d62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:11.790130 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-35642c12-ba61-444a-b04a-f1bd8cf34d62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:11.790574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-35642c12-ba61-444a-b04a-f1bd8cf34d62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:11.934038 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-35642c12-ba61-444a-b04a-f1bd8cf34d62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:11.942842 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-35642c12-ba61-444a-b04a-f1bd8cf34d62 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.173522 Jun 30 13:12:11.943413 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 304/611] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:11 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:12.173340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd29096d-da65-4abc-a678-f9a1c06e5bf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:12.174191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd29096d-da65-4abc-a678-f9a1c06e5bf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:12.183569 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd29096d-da65-4abc-a678-f9a1c06e5bf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:12.184014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd29096d-da65-4abc-a678-f9a1c06e5bf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:12.184748 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd29096d-da65-4abc-a678-f9a1c06e5bf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:12.185169 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd29096d-da65-4abc-a678-f9a1c06e5bf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:12.322755 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd29096d-da65-4abc-a678-f9a1c06e5bf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:12.326356 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:12.331310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd29096d-da65-4abc-a678-f9a1c06e5bf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.164678 Jun 30 13:12:12.331845 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 308/612] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:12 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:12.963588 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2330b9b9-daf8-4088-8add-32139db61fd1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:12.964272 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2330b9b9-daf8-4088-8add-32139db61fd1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:12.971582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2330b9b9-daf8-4088-8add-32139db61fd1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:12.972017 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2330b9b9-daf8-4088-8add-32139db61fd1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:12.972775 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2330b9b9-daf8-4088-8add-32139db61fd1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:12.973195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2330b9b9-daf8-4088-8add-32139db61fd1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:12.977303 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:13.108629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2330b9b9-daf8-4088-8add-32139db61fd1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:13.117108 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2330b9b9-daf8-4088-8add-32139db61fd1 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1733 microversion: 2.1 time: 0.159695 Jun 30 13:12:13.117657 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 305/613] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:12 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:13.354158 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27ecdbcc-9ed2-4876-895d-79c2d0a2c0d8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:13.355134 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27ecdbcc-9ed2-4876-895d-79c2d0a2c0d8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:13.362397 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27ecdbcc-9ed2-4876-895d-79c2d0a2c0d8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:13.362881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27ecdbcc-9ed2-4876-895d-79c2d0a2c0d8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:13.363600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27ecdbcc-9ed2-4876-895d-79c2d0a2c0d8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:13.364032 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27ecdbcc-9ed2-4876-895d-79c2d0a2c0d8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:13.510701 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-27ecdbcc-9ed2-4876-895d-79c2d0a2c0d8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:13.522257 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27ecdbcc-9ed2-4876-895d-79c2d0a2c0d8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.175122 Jun 30 13:12:13.522960 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 309/614] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:13 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:14.135909 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-62a9073b-46db-47b7-bca2-28b97c279203 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:14.136514 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-62a9073b-46db-47b7-bca2-28b97c279203 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:14.143709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-62a9073b-46db-47b7-bca2-28b97c279203 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.144149 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-62a9073b-46db-47b7-bca2-28b97c279203 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.144904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-62a9073b-46db-47b7-bca2-28b97c279203 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.145323 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-62a9073b-46db-47b7-bca2-28b97c279203 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.281768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-62a9073b-46db-47b7-bca2-28b97c279203 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:14.290042 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-62a9073b-46db-47b7-bca2-28b97c279203 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1713 microversion: 2.1 time: 0.158525 Jun 30 13:12:14.290650 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 306/615] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:14 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:14.404253 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:14.404821 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:14.411549 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.411994 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.412752 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.413179 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.505658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] HTTP exception thrown: Cannot 'detach_volume' instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 while it is in vm_state rescued Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Request method failure captured: Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments/11e92339-2224-4deb-a806-a813eff4d326 HTTP/1.1 Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaAIiDqmzBk003FXqe908sKplnTOTTe0uls5Nb8W8-zMdKmCsB-qpzXIvF9yYVYkb9yALsgVIgttIi01Upr8CXOW-00eiFTlAUMZr93waJwCoH1jb-eeAiJZG7ktMvlqrdytI7P28ZHMQbEezLOmyoqkbkEskw-g3MbLo0VWlZFO-ZE Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:12:14.507287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_792f217e834c4049b5b0d856cd53f947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}] Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: a7ce962e4a7447848e3454905102d27c Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:12:14.508719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Cannot 'detach_volume' instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 while it is in vm_state rescued Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '9d58b08a-c2ee-4f45-90c0-400b9e677939', 'id': '11e92339-2224-4deb-a806-a813eff4d326'} Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:12:14.509471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 while it is in vm_state rescued Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 while it is in vm_state rescued Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:14.510719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Returning 409 to user: Cannot 'detach_volume' instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 while it is in vm_state rescued {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:12:14.511672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-31594b60-c11b-425e-ba35-60cfedeae690 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments/11e92339-2224-4deb-a806-a813eff4d326" status: 409 len: 152 microversion: 2.1 time: 0.110598 Jun 30 13:12:14.511672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 310/616] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:12:14 2022] DELETE /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments/11e92339-2224-4deb-a806-a813eff4d326 => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 13:12:14.517903 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1079a2d1-2a81-4a0b-97b1-7ef75fe1c273 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:14.518456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1079a2d1-2a81-4a0b-97b1-7ef75fe1c273 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:14.520319 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=33 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:14.525501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1079a2d1-2a81-4a0b-97b1-7ef75fe1c273 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.525932 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1079a2d1-2a81-4a0b-97b1-7ef75fe1c273 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.527023 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1079a2d1-2a81-4a0b-97b1-7ef75fe1c273 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.527451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1079a2d1-2a81-4a0b-97b1-7ef75fe1c273 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.539544 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82943c65-096a-4404-9b46-c03d15576bea tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:14.540146 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82943c65-096a-4404-9b46-c03d15576bea tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:14.547378 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82943c65-096a-4404-9b46-c03d15576bea tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.547820 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82943c65-096a-4404-9b46-c03d15576bea tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.548580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82943c65-096a-4404-9b46-c03d15576bea tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.549007 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82943c65-096a-4404-9b46-c03d15576bea tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.603789 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1079a2d1-2a81-4a0b-97b1-7ef75fe1c273 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "POST /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/action" status: 202 len: 0 microversion: 2.1 time: 0.089538 Jun 30 13:12:14.604979 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 307/617] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:12:14 2022] POST /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:12:14.613998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6a61eebf-5ff4-4366-a818-bf81d4944ac4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:14.614741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6a61eebf-5ff4-4366-a818-bf81d4944ac4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:14.625372 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6a61eebf-5ff4-4366-a818-bf81d4944ac4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.625929 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6a61eebf-5ff4-4366-a818-bf81d4944ac4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.626736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6a61eebf-5ff4-4366-a818-bf81d4944ac4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:14.627183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6a61eebf-5ff4-4366-a818-bf81d4944ac4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:14.687728 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-82943c65-096a-4404-9b46-c03d15576bea tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:14.695525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82943c65-096a-4404-9b46-c03d15576bea tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1677 microversion: 2.1 time: 0.159870 Jun 30 13:12:14.696313 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 311/618] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:14 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:14.862337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6a61eebf-5ff4-4366-a818-bf81d4944ac4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:14.870797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6a61eebf-5ff4-4366-a818-bf81d4944ac4 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1721 microversion: 2.1 time: 0.260894 Jun 30 13:12:14.871388 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 308/619] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:14 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:12:15.714163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-51cc875c-f50a-470b-b4e4-4317204cfc6e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:15.714835 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-51cc875c-f50a-470b-b4e4-4317204cfc6e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:15.722077 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51cc875c-f50a-470b-b4e4-4317204cfc6e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:15.722555 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51cc875c-f50a-470b-b4e4-4317204cfc6e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:15.723310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51cc875c-f50a-470b-b4e4-4317204cfc6e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:15.723736 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-51cc875c-f50a-470b-b4e4-4317204cfc6e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:15.863177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-51cc875c-f50a-470b-b4e4-4317204cfc6e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:15.871085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-51cc875c-f50a-470b-b4e4-4317204cfc6e tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1654 microversion: 2.1 time: 0.161247 Jun 30 13:12:15.871651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 312/620] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:15 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1654 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:15.887612 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5491cec2-40c8-46c5-97d4-5563f0827408 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:15.889006 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-88844708-ee00-4d57-8ab8-5ce3dfbfb798 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:15.889644 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-88844708-ee00-4d57-8ab8-5ce3dfbfb798 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:15.894119 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5491cec2-40c8-46c5-97d4-5563f0827408 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:15.894580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5491cec2-40c8-46c5-97d4-5563f0827408 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:15.895711 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88844708-ee00-4d57-8ab8-5ce3dfbfb798 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:15.896159 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88844708-ee00-4d57-8ab8-5ce3dfbfb798 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:15.896919 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88844708-ee00-4d57-8ab8-5ce3dfbfb798 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:15.897341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-88844708-ee00-4d57-8ab8-5ce3dfbfb798 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:15.917165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5491cec2-40c8-46c5-97d4-5563f0827408 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Going to try to start instance {{(pid=117826) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 13:12:15.963888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5491cec2-40c8-46c5-97d4-5563f0827408 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/action" status: 202 len: 0 microversion: 2.1 time: 0.079965 Jun 30 13:12:15.964552 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 309/621] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:12:15 2022] POST /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:12:15.973187 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-76739778-0029-42cc-86f1-4c761187b6ce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:15.973861 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-76739778-0029-42cc-86f1-4c761187b6ce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:15.980188 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-76739778-0029-42cc-86f1-4c761187b6ce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:15.980621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-76739778-0029-42cc-86f1-4c761187b6ce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:15.981368 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-76739778-0029-42cc-86f1-4c761187b6ce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:15.981784 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-76739778-0029-42cc-86f1-4c761187b6ce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:16.037950 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-88844708-ee00-4d57-8ab8-5ce3dfbfb798 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:16.046616 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-88844708-ee00-4d57-8ab8-5ce3dfbfb798 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1721 microversion: 2.1 time: 0.161283 Jun 30 13:12:16.047483 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 313/622] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:15 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:16.116749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-76739778-0029-42cc-86f1-4c761187b6ce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:16.128078 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-76739778-0029-42cc-86f1-4c761187b6ce tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1663 microversion: 2.1 time: 0.158552 Jun 30 13:12:16.128777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 310/623] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:15 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:12:17.067994 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3e53f736-e298-4666-94dd-e18a0a8de88b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:17.068627 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3e53f736-e298-4666-94dd-e18a0a8de88b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:17.077071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e53f736-e298-4666-94dd-e18a0a8de88b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:17.077541 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e53f736-e298-4666-94dd-e18a0a8de88b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:17.078560 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e53f736-e298-4666-94dd-e18a0a8de88b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:17.079009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3e53f736-e298-4666-94dd-e18a0a8de88b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:17.149595 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-afd3e81c-9e91-4577-9402-7e15b0bed1c2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:17.150988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-afd3e81c-9e91-4577-9402-7e15b0bed1c2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:17.160742 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-afd3e81c-9e91-4577-9402-7e15b0bed1c2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:17.161402 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-afd3e81c-9e91-4577-9402-7e15b0bed1c2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:17.162421 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-afd3e81c-9e91-4577-9402-7e15b0bed1c2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:17.162863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-afd3e81c-9e91-4577-9402-7e15b0bed1c2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:17.231709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-3e53f736-e298-4666-94dd-e18a0a8de88b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:17.240570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3e53f736-e298-4666-94dd-e18a0a8de88b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1721 microversion: 2.1 time: 0.178389 Jun 30 13:12:17.241125 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 314/624] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:17 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:17.304938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-afd3e81c-9e91-4577-9402-7e15b0bed1c2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:17.313592 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-afd3e81c-9e91-4577-9402-7e15b0bed1c2 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1663 microversion: 2.1 time: 0.170393 Jun 30 13:12:17.314222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 311/625] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:17 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:18.258677 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b0b5be95-6d89-4e0f-8167-551271f0709e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:18.259331 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b0b5be95-6d89-4e0f-8167-551271f0709e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:18.266623 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0b5be95-6d89-4e0f-8167-551271f0709e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:18.267132 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0b5be95-6d89-4e0f-8167-551271f0709e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:18.268131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0b5be95-6d89-4e0f-8167-551271f0709e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:18.268633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b0b5be95-6d89-4e0f-8167-551271f0709e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:18.333182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c12d3d0f-895d-49f5-863b-8bbaa39b73db tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:18.333794 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c12d3d0f-895d-49f5-863b-8bbaa39b73db tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:18.340533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c12d3d0f-895d-49f5-863b-8bbaa39b73db tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:18.340969 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c12d3d0f-895d-49f5-863b-8bbaa39b73db tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:18.341725 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c12d3d0f-895d-49f5-863b-8bbaa39b73db tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:18.342147 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c12d3d0f-895d-49f5-863b-8bbaa39b73db tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:18.404362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b0b5be95-6d89-4e0f-8167-551271f0709e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:18.412649 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b0b5be95-6d89-4e0f-8167-551271f0709e tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1727 microversion: 2.1 time: 0.158032 Jun 30 13:12:18.413222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 315/626] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:18 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:18.429300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bdca42cd-1223-443b-8fd9-b40bd9351673 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:18.429905 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bdca42cd-1223-443b-8fd9-b40bd9351673 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:18.436168 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdca42cd-1223-443b-8fd9-b40bd9351673 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:18.436610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdca42cd-1223-443b-8fd9-b40bd9351673 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:18.437399 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdca42cd-1223-443b-8fd9-b40bd9351673 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:18.437825 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bdca42cd-1223-443b-8fd9-b40bd9351673 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:18.475768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c12d3d0f-895d-49f5-863b-8bbaa39b73db tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:18.483699 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c12d3d0f-895d-49f5-863b-8bbaa39b73db tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1663 microversion: 2.1 time: 0.154398 Jun 30 13:12:18.484265 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 312/627] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:18 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:18.515234 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bdca42cd-1223-443b-8fd9-b40bd9351673 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089420 Jun 30 13:12:18.516046 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 316/628] 10.222.0.49 () {58 vars in 1274 bytes} [Thu Jun 30 13:12:18 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:12:19.501251 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-16061ba9-26e0-4c0e-80e3-11b62c77fd0f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:19.501819 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-16061ba9-26e0-4c0e-80e3-11b62c77fd0f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:19.508779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-16061ba9-26e0-4c0e-80e3-11b62c77fd0f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:19.509212 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-16061ba9-26e0-4c0e-80e3-11b62c77fd0f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:19.509960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-16061ba9-26e0-4c0e-80e3-11b62c77fd0f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:19.510413 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-16061ba9-26e0-4c0e-80e3-11b62c77fd0f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:19.627216 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-a4d8fb67-f67f-46c2-a597-dbacae156f66 req-abfc5e1c-3125-4104-a641-5f60a9963de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d58b08a-c2ee-4f45-90c0-400b9e677939", "tag": "f167dfd2-b19b-402d-b775-ccdceb0797f3"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:19.650222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a4d8fb67-f67f-46c2-a597-dbacae156f66 req-abfc5e1c-3125-4104-a641-5f60a9963de6 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:19.651238 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-16061ba9-26e0-4c0e-80e3-11b62c77fd0f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:19.654789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a4d8fb67-f67f-46c2-a597-dbacae156f66 req-abfc5e1c-3125-4104-a641-5f60a9963de6 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:19.660427 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-16061ba9-26e0-4c0e-80e3-11b62c77fd0f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1663 microversion: 2.1 time: 0.163201 Jun 30 13:12:19.661254 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 313/629] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:19 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:19.671444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-a4d8fb67-f67f-46c2-a597-dbacae156f66 req-abfc5e1c-3125-4104-a641-5f60a9963de6 service nova] Creating event network-changed:f167dfd2-b19b-402d-b775-ccdceb0797f3 for instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 on hv-cinder-81268 Jun 30 13:12:19.676503 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-a4d8fb67-f67f-46c2-a597-dbacae156f66 req-abfc5e1c-3125-4104-a641-5f60a9963de6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054308 Jun 30 13:12:19.677116 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 317/630] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:20.677653 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-298d23b1-0a89-4e27-a8f7-23c39112e723 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:20.678519 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-298d23b1-0a89-4e27-a8f7-23c39112e723 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:20.692315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-298d23b1-0a89-4e27-a8f7-23c39112e723 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:20.692728 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-298d23b1-0a89-4e27-a8f7-23c39112e723 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:20.693915 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-298d23b1-0a89-4e27-a8f7-23c39112e723 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:20.694336 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-298d23b1-0a89-4e27-a8f7-23c39112e723 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:20.866608 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-149a4c6c-bde7-4ded-b286-e76d0347ad51 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:20.867255 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-149a4c6c-bde7-4ded-b286-e76d0347ad51 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:20.873633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-149a4c6c-bde7-4ded-b286-e76d0347ad51 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:20.874073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-149a4c6c-bde7-4ded-b286-e76d0347ad51 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:20.874864 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-149a4c6c-bde7-4ded-b286-e76d0347ad51 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:20.875284 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-149a4c6c-bde7-4ded-b286-e76d0347ad51 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:20.898633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-149a4c6c-bde7-4ded-b286-e76d0347ad51 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374/ips" status: 200 len: 149 microversion: 2.1 time: 0.155795 Jun 30 13:12:20.899225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 318/631] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:12:20 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374/ips => generated 149 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:20.909921 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1097e130-581f-4a40-a8e5-90dc1e3a2728"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:20.911144 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:20.915246 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-298d23b1-0a89-4e27-a8f7-23c39112e723 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:20.917359 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:20.918482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:20.919254 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:20.919677 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:20.924032 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-298d23b1-0a89-4e27-a8f7-23c39112e723 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1667 microversion: 2.1 time: 0.250334 Jun 30 13:12:20.924864 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 314/632] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:20 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1667 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:21.005894 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Invalid volume: volume 1097e130-581f-4a40-a8e5-90dc1e3a2728 is already attached to instances: c10b1702-58cf-40cd-b199-96482a3f4721 Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: POST /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374/os-volume_attachments HTTP/1.1 Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 74 Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:12:21.007658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {"volumeAttachment": {"volumeId": "1097e130-581f-4a40-a8e5-90dc1e3a2728"}} Jun 30 13:12:21.009207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Invalid volume: volume 1097e130-581f-4a40-a8e5-90dc1e3a2728 is already attached to instances: c10b1702-58cf-40cd-b199-96482a3f4721 Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '03580d48-01c9-4c1d-bcb6-39a8914b2374', 'body': {'volumeAttachment': {'volumeId': '1097e130-581f-4a40-a8e5-90dc1e3a2728'}}} Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1097e130-581f-4a40-a8e5-90dc1e3a2728 is already attached to instances: c10b1702-58cf-40cd-b199-96482a3f4721 Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:21.010045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1097e130-581f-4a40-a8e5-90dc1e3a2728 is already attached to instances: c10b1702-58cf-40cd-b199-96482a3f4721 Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:21.011482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:21.012858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:21.012858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:12:21.012858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:12:21.012858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1097e130-581f-4a40-a8e5-90dc1e3a2728 is already attached to instances: c10b1702-58cf-40cd-b199-96482a3f4721 Jun 30 13:12:21.012858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:21.012858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 400 to user: Invalid volume: volume 1097e130-581f-4a40-a8e5-90dc1e3a2728 is already attached to instances: c10b1702-58cf-40cd-b199-96482a3f4721 {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:12:21.012858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-563f9cc3-78e0-41b6-997f-215ff6ab2b0e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103020 Jun 30 13:12:21.012858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 319/633] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:12:20 2022] POST /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:12:21.018534 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6767cf12-3ff0-41d8-9d4e-4ade567b3a7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:21.019027 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6767cf12-3ff0-41d8-9d4e-4ade567b3a7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:21.025055 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6767cf12-3ff0-41d8-9d4e-4ade567b3a7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:21.025489 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6767cf12-3ff0-41d8-9d4e-4ade567b3a7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:21.026235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6767cf12-3ff0-41d8-9d4e-4ade567b3a7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:21.026827 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6767cf12-3ff0-41d8-9d4e-4ade567b3a7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:21.051060 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6767cf12-3ff0-41d8-9d4e-4ade567b3a7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:12:21.137910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6767cf12-3ff0-41d8-9d4e-4ade567b3a7b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 204 len: 0 microversion: 2.1 time: 0.123234 Jun 30 13:12:21.138533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 315/634] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:12:21 2022] DELETE /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 13:12:21.146965 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-45903bdd-1c38-4a44-a2b0-2190c625574d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:21.147683 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-45903bdd-1c38-4a44-a2b0-2190c625574d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:21.155030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45903bdd-1c38-4a44-a2b0-2190c625574d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:21.155463 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45903bdd-1c38-4a44-a2b0-2190c625574d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:21.156216 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45903bdd-1c38-4a44-a2b0-2190c625574d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:21.156639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-45903bdd-1c38-4a44-a2b0-2190c625574d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:21.296351 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-45903bdd-1c38-4a44-a2b0-2190c625574d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:21.304167 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-45903bdd-1c38-4a44-a2b0-2190c625574d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1679 microversion: 2.1 time: 0.161237 Jun 30 13:12:21.304723 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 320/635] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:21 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:21.698938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-3e339a87-3c58-4a30-a1e1-851e85a2294c req-c7fca616-c3a2-44fa-8409-9f3ad135a81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d58b08a-c2ee-4f45-90c0-400b9e677939", "tag": "f167dfd2-b19b-402d-b775-ccdceb0797f3"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:21.713827 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3e339a87-3c58-4a30-a1e1-851e85a2294c req-c7fca616-c3a2-44fa-8409-9f3ad135a81d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:21.715116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3e339a87-3c58-4a30-a1e1-851e85a2294c req-c7fca616-c3a2-44fa-8409-9f3ad135a81d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:21.726933 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-3e339a87-3c58-4a30-a1e1-851e85a2294c req-c7fca616-c3a2-44fa-8409-9f3ad135a81d service nova] Creating event network-changed:f167dfd2-b19b-402d-b775-ccdceb0797f3 for instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 on hv-cinder-81268 Jun 30 13:12:21.732039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-3e339a87-3c58-4a30-a1e1-851e85a2294c req-c7fca616-c3a2-44fa-8409-9f3ad135a81d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040942 Jun 30 13:12:21.732790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 316/636] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:22.321370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-32d8006d-1229-4a9d-9d87-8436e940dfa3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:22.321969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-32d8006d-1229-4a9d-9d87-8436e940dfa3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:22.324532 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=53 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:22.330300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32d8006d-1229-4a9d-9d87-8436e940dfa3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:22.330757 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32d8006d-1229-4a9d-9d87-8436e940dfa3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:22.331503 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32d8006d-1229-4a9d-9d87-8436e940dfa3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:22.331921 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-32d8006d-1229-4a9d-9d87-8436e940dfa3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:22.470055 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-32d8006d-1229-4a9d-9d87-8436e940dfa3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:22.482382 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-32d8006d-1229-4a9d-9d87-8436e940dfa3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1679 microversion: 2.1 time: 0.164623 Jun 30 13:12:22.483190 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 321/637] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:22 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:23.506236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a7b66f85-25c4-41ee-898b-af22966d3ec3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:23.507101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a7b66f85-25c4-41ee-898b-af22966d3ec3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:23.514299 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a7b66f85-25c4-41ee-898b-af22966d3ec3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:23.514847 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a7b66f85-25c4-41ee-898b-af22966d3ec3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:23.515875 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a7b66f85-25c4-41ee-898b-af22966d3ec3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:23.516301 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a7b66f85-25c4-41ee-898b-af22966d3ec3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:23.794241 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a7b66f85-25c4-41ee-898b-af22966d3ec3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:23.802206 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a7b66f85-25c4-41ee-898b-af22966d3ec3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1679 microversion: 2.1 time: 0.300764 Jun 30 13:12:23.802814 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 317/638] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:23 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1679 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:24.622341 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-2e812e1b-580d-48ce-9c71-c9b71fcddc30 req-35c66f67-ca77-48ef-9425-aa1de3d15ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03580d48-01c9-4c1d-bcb6-39a8914b2374", "name": "network-vif-deleted", "tag": "950411eb-3cd3-48e2-ac9b-4fb6e9b617f9"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:24.631181 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-2e812e1b-580d-48ce-9c71-c9b71fcddc30 req-35c66f67-ca77-48ef-9425-aa1de3d15ad5 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:24.631764 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-2e812e1b-580d-48ce-9c71-c9b71fcddc30 req-35c66f67-ca77-48ef-9425-aa1de3d15ad5 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:24.643611 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-2e812e1b-580d-48ce-9c71-c9b71fcddc30 req-35c66f67-ca77-48ef-9425-aa1de3d15ad5 service nova] Creating event network-vif-deleted:950411eb-3cd3-48e2-ac9b-4fb6e9b617f9 for instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 on hv-cinder-81268 Jun 30 13:12:24.649031 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-2e812e1b-580d-48ce-9c71-c9b71fcddc30 req-35c66f67-ca77-48ef-9425-aa1de3d15ad5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094943 Jun 30 13:12:24.649530 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 322/639] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:24.819933 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:24.820508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:24.827397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:24.828088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:24.828849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:24.829276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:24.860894 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:24.861327 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:24.861766 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'fault' on Instance uuid 03580d48-01c9-4c1d-bcb6-39a8914b2374 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:12:24.864752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:24.906645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:24.914358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f0e8e57e-afb3-470a-a918-66ed89771cbd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 200 len: 1330 microversion: 2.1 time: 0.098325 Jun 30 13:12:24.915435 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 318/640] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:24 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:25.933346 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:25.934145 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:25.940933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:25.941377 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:25.942159 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:25.942633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:25.957629 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 HTTP/1.1 Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:12:25.959329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:12:25.960804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '03580d48-01c9-4c1d-bcb6-39a8914b2374'} Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:12:25.961665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:12:25.963040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:25.964479 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:12:25.964479 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-94dafa68-8f06-4f71-97f1-24f059c4af8b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 404 len: 111 microversion: 2.1 time: 0.032392 Jun 30 13:12:25.964744 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 323/641] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:25 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 13:12:25.970314 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7ecce01e-269a-4933-8974-bad109c2f81b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '.version_select at 0x7f4b9f77ac10>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:25.974088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7ecce01e-269a-4933-8974-bad109c2f81b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [8ac4f015-9cd8-43e9-b441-f3352ecd5c34] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 13:12:26.985897 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO oslo.messaging._drivers.impl_rabbit [None req-7ecce01e-269a-4933-8974-bad109c2f81b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [8ac4f015-9cd8-43e9-b441-f3352ecd5c34] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 36648. Jun 30 13:12:27.012452 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7ecce01e-269a-4933-8974-bad109c2f81b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622877281" status: 202 len: 0 microversion: 2.1 time: 1.046453 Jun 30 13:12:27.013057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 319/642] 10.222.0.49 () {58 vars in 1217 bytes} [Thu Jun 30 13:12:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622877281 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:12:27.694182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6bfed7b3-69d9-4dcf-9416-b9772afc7f95 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:27.694782 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6bfed7b3-69d9-4dcf-9416-b9772afc7f95 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:27.701392 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6bfed7b3-69d9-4dcf-9416-b9772afc7f95 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:27.701809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6bfed7b3-69d9-4dcf-9416-b9772afc7f95 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:27.702628 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6bfed7b3-69d9-4dcf-9416-b9772afc7f95 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:27.703074 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6bfed7b3-69d9-4dcf-9416-b9772afc7f95 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:27.787507 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-6bfed7b3-69d9-4dcf-9416-b9772afc7f95 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'services' on Instance uuid c10b1702-58cf-40cd-b199-96482a3f4721 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:12:27.870488 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6bfed7b3-69d9-4dcf-9416-b9772afc7f95 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-volume_attachments/1097e130-581f-4a40-a8e5-90dc1e3a2728" status: 202 len: 0 microversion: 2.1 time: 0.179785 Jun 30 13:12:27.871068 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 324/643] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:12:27 2022] DELETE /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-volume_attachments/1097e130-581f-4a40-a8e5-90dc1e3a2728 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:12:27.879863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-03655994-448d-4a22-bb88-6468217fe69c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:27.880785 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-03655994-448d-4a22-bb88-6468217fe69c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:27.887946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03655994-448d-4a22-bb88-6468217fe69c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:27.888425 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03655994-448d-4a22-bb88-6468217fe69c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:27.889432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03655994-448d-4a22-bb88-6468217fe69c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:27.889849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03655994-448d-4a22-bb88-6468217fe69c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:27.919649 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-03655994-448d-4a22-bb88-6468217fe69c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Jun 30 13:12:27.920197 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 320/644] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:12:27 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:28.933593 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9f13689e-af47-46a0-9487-998233885396 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:28.934877 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9f13689e-af47-46a0-9487-998233885396 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:28.942985 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f13689e-af47-46a0-9487-998233885396 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:28.943423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f13689e-af47-46a0-9487-998233885396 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:28.944187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f13689e-af47-46a0-9487-998233885396 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:28.944610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f13689e-af47-46a0-9487-998233885396 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:28.975887 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9f13689e-af47-46a0-9487-998233885396 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047272 Jun 30 13:12:28.976429 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 325/645] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:12:28 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:12:29.034839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-84b769f4-302c-4502-a3d1-5777de5a69cc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:29.035360 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-84b769f4-302c-4502-a3d1-5777de5a69cc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:29.041896 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-84b769f4-302c-4502-a3d1-5777de5a69cc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.042420 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-84b769f4-302c-4502-a3d1-5777de5a69cc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.043112 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-84b769f4-302c-4502-a3d1-5777de5a69cc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.043533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-84b769f4-302c-4502-a3d1-5777de5a69cc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.068401 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-84b769f4-302c-4502-a3d1-5777de5a69cc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:12:29.150721 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-84b769f4-302c-4502-a3d1-5777de5a69cc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 204 len: 0 microversion: 2.1 time: 0.119215 Jun 30 13:12:29.151316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 321/646] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:12:29 2022] DELETE /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:12:29.159929 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a87ef93d-1933-4098-bc4e-80eb3335b71a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:29.160518 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a87ef93d-1933-4098-bc4e-80eb3335b71a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:29.166554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a87ef93d-1933-4098-bc4e-80eb3335b71a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.166999 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a87ef93d-1933-4098-bc4e-80eb3335b71a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.167744 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a87ef93d-1933-4098-bc4e-80eb3335b71a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.168167 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a87ef93d-1933-4098-bc4e-80eb3335b71a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.302890 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a87ef93d-1933-4098-bc4e-80eb3335b71a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:29.310818 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a87ef93d-1933-4098-bc4e-80eb3335b71a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1682 microversion: 2.1 time: 0.154845 Jun 30 13:12:29.311388 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 326/647] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:29 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:29.679634 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e7649c37-2240-4966-aca9-29dfe9fc723e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:29.680220 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e7649c37-2240-4966-aca9-29dfe9fc723e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:29.686566 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e7649c37-2240-4966-aca9-29dfe9fc723e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.687001 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e7649c37-2240-4966-aca9-29dfe9fc723e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.687760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e7649c37-2240-4966-aca9-29dfe9fc723e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.688182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e7649c37-2240-4966-aca9-29dfe9fc723e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.718000 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e7649c37-2240-4966-aca9-29dfe9fc723e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments/cfaf76b9-2698-4a96-9341-197cda0e78f4" status: 200 len: 194 microversion: 2.20 time: 0.167909 Jun 30 13:12:29.718616 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 322/648] 10.222.0.49 () {60 vars in 1453 bytes} [Thu Jun 30 13:12:29 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments/cfaf76b9-2698-4a96-9341-197cda0e78f4 => generated 194 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 13:12:29.788345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9bd7b1f8-1c53-4606-855e-a9ed62401da0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:29.788832 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9bd7b1f8-1c53-4606-855e-a9ed62401da0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:29.795437 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bd7b1f8-1c53-4606-855e-a9ed62401da0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.795885 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bd7b1f8-1c53-4606-855e-a9ed62401da0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.796644 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bd7b1f8-1c53-4606-855e-a9ed62401da0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.797071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9bd7b1f8-1c53-4606-855e-a9ed62401da0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.816312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:29.882008 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-9bd7b1f8-1c53-4606-855e-a9ed62401da0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lazy-loading 'services' on Instance uuid 7f2c8af5-6d65-4177-9434-65a1d15813c9 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:12:29.959347 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9bd7b1f8-1c53-4606-855e-a9ed62401da0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments/cfaf76b9-2698-4a96-9341-197cda0e78f4" status: 202 len: 0 microversion: 2.20 time: 0.174872 Jun 30 13:12:29.960008 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 327/649] 10.222.0.49 () {60 vars in 1456 bytes} [Thu Jun 30 13:12:29 2022] DELETE /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments/cfaf76b9-2698-4a96-9341-197cda0e78f4 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:12:29.969923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-967dd709-ecd4-40ce-847b-1f496177c829 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:29.970899 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-967dd709-ecd4-40ce-847b-1f496177c829 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:29.978233 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-967dd709-ecd4-40ce-847b-1f496177c829 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.978706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-967dd709-ecd4-40ce-847b-1f496177c829 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:29.979451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-967dd709-ecd4-40ce-847b-1f496177c829 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:29.979871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-967dd709-ecd4-40ce-847b-1f496177c829 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:30.014362 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-967dd709-ecd4-40ce-847b-1f496177c829 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049362 Jun 30 13:12:30.015213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 323/650] 10.222.0.49 () {60 vars in 1342 bytes} [Thu Jun 30 13:12:29 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 13:12:30.329293 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-54546980-4718-46bb-8f8d-2fa884ea284e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:30.329977 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-54546980-4718-46bb-8f8d-2fa884ea284e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:30.337145 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54546980-4718-46bb-8f8d-2fa884ea284e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:30.337574 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54546980-4718-46bb-8f8d-2fa884ea284e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:30.338346 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54546980-4718-46bb-8f8d-2fa884ea284e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:30.338775 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-54546980-4718-46bb-8f8d-2fa884ea284e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:30.480737 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-54546980-4718-46bb-8f8d-2fa884ea284e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:30.488897 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-54546980-4718-46bb-8f8d-2fa884ea284e tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1682 microversion: 2.1 time: 0.163934 Jun 30 13:12:30.489468 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 328/651] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:30 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:31.027151 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bf19ba08-a168-4810-a83a-e1319fb29c3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:31.028131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bf19ba08-a168-4810-a83a-e1319fb29c3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:31.035552 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf19ba08-a168-4810-a83a-e1319fb29c3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:31.035991 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf19ba08-a168-4810-a83a-e1319fb29c3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:31.037045 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf19ba08-a168-4810-a83a-e1319fb29c3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:31.037467 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf19ba08-a168-4810-a83a-e1319fb29c3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:31.068829 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bf19ba08-a168-4810-a83a-e1319fb29c3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045978 Jun 30 13:12:31.069395 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 324/652] 10.222.0.49 () {60 vars in 1342 bytes} [Thu Jun 30 13:12:31 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 13:12:31.507431 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c45e38ad-0e16-47b9-824a-aaa7354c4e78 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:31.508069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c45e38ad-0e16-47b9-824a-aaa7354c4e78 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:31.515021 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c45e38ad-0e16-47b9-824a-aaa7354c4e78 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:31.515473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c45e38ad-0e16-47b9-824a-aaa7354c4e78 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:31.516239 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c45e38ad-0e16-47b9-824a-aaa7354c4e78 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:31.516669 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c45e38ad-0e16-47b9-824a-aaa7354c4e78 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:31.538802 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-0cb6325a-a2c4-41e4-97e6-6f1125586842 req-fc679b10-78ea-4043-a882-ea96a78fa2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10b1702-58cf-40cd-b199-96482a3f4721", "name": "network-vif-deleted", "tag": "5b9dd1a2-b979-4c96-b0dc-ed91d8fe6a47"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:31.559646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-0cb6325a-a2c4-41e4-97e6-6f1125586842 req-fc679b10-78ea-4043-a882-ea96a78fa2fb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:31.560512 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-0cb6325a-a2c4-41e4-97e6-6f1125586842 req-fc679b10-78ea-4043-a882-ea96a78fa2fb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:31.577643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-0cb6325a-a2c4-41e4-97e6-6f1125586842 req-fc679b10-78ea-4043-a882-ea96a78fa2fb service nova] Creating event network-vif-deleted:5b9dd1a2-b979-4c96-b0dc-ed91d8fe6a47 for instance c10b1702-58cf-40cd-b199-96482a3f4721 on hv-cinder-81268 Jun 30 13:12:31.582877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-0cb6325a-a2c4-41e4-97e6-6f1125586842 req-fc679b10-78ea-4043-a882-ea96a78fa2fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047608 Jun 30 13:12:31.583768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 325/653] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:31.609339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c45e38ad-0e16-47b9-824a-aaa7354c4e78 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:31.618904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c45e38ad-0e16-47b9-824a-aaa7354c4e78 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 200 len: 1614 microversion: 2.1 time: 0.115169 Jun 30 13:12:31.619908 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 329/654] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:31 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:32.082124 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-03e17209-37a2-48a0-8248-1495cab713e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:32.083250 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-03e17209-37a2-48a0-8248-1495cab713e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:32.090676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03e17209-37a2-48a0-8248-1495cab713e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:32.091218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03e17209-37a2-48a0-8248-1495cab713e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:32.092022 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03e17209-37a2-48a0-8248-1495cab713e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:32.093454 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03e17209-37a2-48a0-8248-1495cab713e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:32.126556 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-03e17209-37a2-48a0-8248-1495cab713e2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049288 Jun 30 13:12:32.127553 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 326/655] 10.222.0.49 () {60 vars in 1342 bytes} [Thu Jun 30 13:12:32 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:32.194256 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-83593332-a92f-499a-a443-a6f7fbb295ae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:32.195235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-83593332-a92f-499a-a443-a6f7fbb295ae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:32.201814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83593332-a92f-499a-a443-a6f7fbb295ae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:32.202247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83593332-a92f-499a-a443-a6f7fbb295ae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:32.203401 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83593332-a92f-499a-a443-a6f7fbb295ae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:32.203824 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83593332-a92f-499a-a443-a6f7fbb295ae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:32.233156 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-83593332-a92f-499a-a443-a6f7fbb295ae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:12:32.315336 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-83593332-a92f-499a-a443-a6f7fbb295ae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 204 len: 0 microversion: 2.20 time: 0.126250 Jun 30 13:12:32.316560 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 330/656] 10.222.0.49 () {60 vars in 1279 bytes} [Thu Jun 30 13:12:32 2022] DELETE /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 13:12:32.325006 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:32.325631 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:32.332338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:32.332926 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:32.333551 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:32.333971 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:32.469014 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:32.477440 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:32.479104 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:32.480739 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-aa757543-31b8-47d2-8564-66eb029e980c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.159937 Jun 30 13:12:32.481658 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 327/657] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:32 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:12:32.639259 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:32.640184 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:32.647106 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:32.647549 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:32.648314 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:32.648740 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:32.663195 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 HTTP/1.1 Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:12:32.664886 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:12:32.666092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': 'c10b1702-58cf-40cd-b199-96482a3f4721'} Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:12:32.667387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:12:32.668654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:12:32.669797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:12:32.669797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-330794b2-2978-4e75-9da5-6ec4a1f5991d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 404 len: 111 microversion: 2.1 time: 0.033129 Jun 30 13:12:32.669797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 331/658] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:32 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:12:32.675626 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f4d14fb9-972f-4100-9a86-647539d9e067 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '.version_select at 0x7f4ba4046af0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:32.698939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f4d14fb9-972f-4100-9a86-647539d9e067 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011138236" status: 202 len: 0 microversion: 2.1 time: 0.027128 Jun 30 13:12:32.699500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 328/659] 10.222.0.49 () {58 vars in 1220 bytes} [Thu Jun 30 13:12:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011138236 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:12:33.386088 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cfdfb05a-7f85-4a4c-ba2e-71fc1922ca76 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: .version_select at 0x7f4ba439cf70>, body: {"keypair": {"name": "tempest-keypair-295470655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNfppi8LaHeVHODFuPGm2gXvYh9m0cgu4oDuYbOdAK+rf9SeEMu9dvFqkpTb9UKJC7hBXMcXtag6lEj7LJBjn3JGds3sHr1FPv6f5PrvWyNQQ84InCudPVpS364dvQr/A=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:33.405228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-cfdfb05a-7f85-4a4c-ba2e-71fc1922ca76 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for project fb73f41e81224744800e167e0eb69863. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:12:33.409299 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-cfdfb05a-7f85-4a4c-ba2e-71fc1922ca76 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for user 126e2b6fc7114ec3bdc1bb3a99fcf752 and project fb73f41e81224744800e167e0eb69863. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:12:33.450187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cfdfb05a-7f85-4a4c-ba2e-71fc1922ca76 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067934 Jun 30 13:12:33.450990 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 332/660] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:12:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:33.500147 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:33.500750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:33.507177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:33.507615 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:33.508364 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:33.508782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:33.645165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:33.653130 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:33.654808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:33.655959 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6f7ce92a-3b73-4cf2-bb2a-8b78965bc863 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.160523 Jun 30 13:12:33.656510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 329/661] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:33 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:34.674574 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:34.675185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:34.684238 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:34.684697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:34.685737 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:34.686033 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:34.715349 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1353183576", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2789cdc0-70d1-47d5-9191-eacc6cd13622"}], "security_groups": [{"name": "tempest-securitygroup--1146340079"}], "key_name": "tempest-keypair-295470655", "user_data": "}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:34.826628 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:34.834931 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:34.836415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:34.837607 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f7b8b6a1-2c63-44e2-ae4e-65e309c257f9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1722 microversion: 2.20 time: 0.167169 Jun 30 13:12:34.838179 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 333/662] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:34 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:34.874343 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] validate_networks() for [('2789cdc0-70d1-47d5-9191-eacc6cd13622', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:12:35.678527 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:12:35.678733 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:12:35.679184 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:12:35.679742 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:12:35.680148 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:12:35.690052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:35.690554 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:35.691342 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:35.691737 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:35.708812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for project fb73f41e81224744800e167e0eb69863. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:12:35.713309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for user 126e2b6fc7114ec3bdc1bb3a99fcf752 and project fb73f41e81224744800e167e0eb69863. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:12:35.725532 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:12:35.727904 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:12:35.777785 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-686d2b01-05a0-4f5f-9b2b-a477aa3bea12 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.067216 Jun 30 13:12:35.778717 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 330/663] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:12:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:12:35.789093 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34b6c205-048f-41e6-8b1c-839a314a5e76 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:35.791728 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-34b6c205-048f-41e6-8b1c-839a314a5e76 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:35.856316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-a6081dce-a682-4c89-b0e8-17877a6eaa2f req-530cae9c-7128-4abc-8792-8e2348469115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2c8af5-6d65-4177-9434-65a1d15813c9", "name": "network-vif-deleted", "tag": "c11821df-b3b9-4d4d-9e5c-85ddf105efeb"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:35.866706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-a6081dce-a682-4c89-b0e8-17877a6eaa2f req-530cae9c-7128-4abc-8792-8e2348469115 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:35.867312 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-a6081dce-a682-4c89-b0e8-17877a6eaa2f req-530cae9c-7128-4abc-8792-8e2348469115 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:35.879337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-a6081dce-a682-4c89-b0e8-17877a6eaa2f req-530cae9c-7128-4abc-8792-8e2348469115 service nova] Creating event network-vif-deleted:c11821df-b3b9-4d4d-9e5c-85ddf105efeb for instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 on hv-cinder-81268 Jun 30 13:12:35.884889 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-a6081dce-a682-4c89-b0e8-17877a6eaa2f req-530cae9c-7128-4abc-8792-8e2348469115 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Jun 30 13:12:35.890103 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 331/664] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:12:35.897616 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:35.898788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:35.899568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-34b6c205-048f-41e6-8b1c-839a314a5e76 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:35.906466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:35.907216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:35.909358 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-34b6c205-048f-41e6-8b1c-839a314a5e76 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1241 microversion: 2.1 time: 0.124248 Jun 30 13:12:35.909709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:35.910001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 334/665] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:35 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1241 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:35.910556 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:36.003905 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:36.012397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:36.013908 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:36.015126 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5cab1ee4-f30b-4f44-a27b-8b408e9e2a39 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 200 len: 1366 microversion: 2.20 time: 0.123535 Jun 30 13:12:36.015680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 332/666] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:35 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:36.926900 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-280ce5f1-8c37-4eb7-921b-480c2ad071a9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:36.927778 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-280ce5f1-8c37-4eb7-921b-480c2ad071a9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:36.937580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280ce5f1-8c37-4eb7-921b-480c2ad071a9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:36.938093 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280ce5f1-8c37-4eb7-921b-480c2ad071a9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:36.938911 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280ce5f1-8c37-4eb7-921b-480c2ad071a9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:36.939338 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-280ce5f1-8c37-4eb7-921b-480c2ad071a9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:37.003716 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-280ce5f1-8c37-4eb7-921b-480c2ad071a9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:37.011705 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-280ce5f1-8c37-4eb7-921b-480c2ad071a9 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1293 microversion: 2.1 time: 0.089278 Jun 30 13:12:37.012269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 335/667] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:36 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:37.035997 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:37.036602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:37.046259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:37.046752 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:37.047508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:37.047929 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:37.061656 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] HTTP exception thrown: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Request method failure captured: Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 HTTP/1.1 Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-1_WeMwOSYDc2fWzjoKmXYV6ABIeuoq_d3LwT1vgedQjGG_7KwQh14JiGVPLqVzYuys8Sx18PUUjjFny-LbWxKXBM2f9kkHJB4IHZhyCrR40SANKgMonvLEI_YkYxkpZ8hvufq8m72ojOD-qCVB4CIUjna6gEpYNXY1Opo4D4NEZo Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:12:37.063481 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}] Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: e5e99d5484594d13b113f27e77b37efd Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:12:37.064988 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '7f2c8af5-6d65-4177-9434-65a1d15813c9'} Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:12:37.065803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:12:37.067134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:12:37.068216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Returning 404 to user: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:12:37.068216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cdd7329f-692f-49ab-bd4c-988545a7e673 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 404 len: 111 microversion: 2.20 time: 0.035232 Jun 30 13:12:37.068216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 333/668] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:37 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:12:37.074419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-befc7b9b-b091-4657-8e03-5b2b9ca83643 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '.version_select at 0x7f4b9ffef700>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:37.095879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-befc7b9b-b091-4657-8e03-5b2b9ca83643 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531342311" status: 204 len: 0 microversion: 2.20 time: 0.025615 Jun 30 13:12:37.096494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 336/669] 10.222.0.49 () {60 vars in 1258 bytes} [Thu Jun 30 13:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531342311 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 13:12:38.029299 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-aa74a8df-5802-4b88-9333-248c2202ddfd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:38.029902 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-aa74a8df-5802-4b88-9333-248c2202ddfd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:38.036337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aa74a8df-5802-4b88-9333-248c2202ddfd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:38.036939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aa74a8df-5802-4b88-9333-248c2202ddfd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:38.037514 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aa74a8df-5802-4b88-9333-248c2202ddfd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:38.037969 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-aa74a8df-5802-4b88-9333-248c2202ddfd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:38.122300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-aa74a8df-5802-4b88-9333-248c2202ddfd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:38.130730 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-aa74a8df-5802-4b88-9333-248c2202ddfd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1299 microversion: 2.1 time: 0.105336 Jun 30 13:12:38.131554 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 334/670] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:38 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:38.433707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8e2c2154-7de3-42b0-b8a4-d454b2325d3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'create', calling method: .version_select at 0x7f4b9ff6f5e0>, body: {"keypair": {"name": "tempest-keypair-545964002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwogfY7a+HxPmEBUieb8sLZYalqWkfP8VvzzGknpxC7E1CCHLxHBENQ5Jpoq9lUMwaccwvNIKc1HyIlFGEAFbJ7skPFCBd1qSRm4g7ZOI1SvIe8ZMFIXGLVxKasrd1weg=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:38.448185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-8e2c2154-7de3-42b0-b8a4-d454b2325d3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Getting quotas for project cee8ced67bdf4b5ca8aa12a8940b9bea. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:12:38.452016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-8e2c2154-7de3-42b0-b8a4-d454b2325d3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Getting quotas for user e5e99d5484594d13b113f27e77b37efd and project cee8ced67bdf4b5ca8aa12a8940b9bea. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:12:38.475242 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8e2c2154-7de3-42b0-b8a4-d454b2325d3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046098 Jun 30 13:12:38.475919 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 337/671] 10.222.0.49 () {62 vars in 1199 bytes} [Thu Jun 30 13:12:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 13:12:39.147969 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fb6c7812-ba6b-4fc6-bf31-6b78d02e9554 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:39.148570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fb6c7812-ba6b-4fc6-bf31-6b78d02e9554 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:39.155783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fb6c7812-ba6b-4fc6-bf31-6b78d02e9554 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:39.156223 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fb6c7812-ba6b-4fc6-bf31-6b78d02e9554 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:39.156987 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fb6c7812-ba6b-4fc6-bf31-6b78d02e9554 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:39.157407 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fb6c7812-ba6b-4fc6-bf31-6b78d02e9554 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:39.436421 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fb6c7812-ba6b-4fc6-bf31-6b78d02e9554 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:39.444365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fb6c7812-ba6b-4fc6-bf31-6b78d02e9554 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.300318 Jun 30 13:12:39.444941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 335/672] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:39 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:39.585750 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-ef0d88dd-9661-411a-8084-b63eee068d1e req-cb1f0de3-7cb0-415e-b28c-bd7ba09c9070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c42415-7a22-43a3-a838-5bf551bec846", "tag": "39420333-9a35-4720-af7e-4064bfe6cdd7"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:39.601490 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ef0d88dd-9661-411a-8084-b63eee068d1e req-cb1f0de3-7cb0-415e-b28c-bd7ba09c9070 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:39.601914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ef0d88dd-9661-411a-8084-b63eee068d1e req-cb1f0de3-7cb0-415e-b28c-bd7ba09c9070 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:39.614009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-ef0d88dd-9661-411a-8084-b63eee068d1e req-cb1f0de3-7cb0-415e-b28c-bd7ba09c9070 service nova] Creating event network-changed:39420333-9a35-4720-af7e-4064bfe6cdd7 for instance 74c42415-7a22-43a3-a838-5bf551bec846 on hv-cinder-81268 Jun 30 13:12:39.623463 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-ef0d88dd-9661-411a-8084-b63eee068d1e req-cb1f0de3-7cb0-415e-b28c-bd7ba09c9070 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041793 Jun 30 13:12:39.624394 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 338/673] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:40.401031 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-592246847", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bd7028d-1af5-4df0-a72b-3e547cce0e83"}], "security_groups": [{"name": "tempest-securitygroup--1177553176"}], "key_name": "tempest-keypair-545964002", "user_data": "}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:40.461740 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-932dbab6-c64d-4617-a1e9-eedb5db11231 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:40.462446 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-932dbab6-c64d-4617-a1e9-eedb5db11231 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:40.469747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-932dbab6-c64d-4617-a1e9-eedb5db11231 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:40.470188 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-932dbab6-c64d-4617-a1e9-eedb5db11231 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:40.470972 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-932dbab6-c64d-4617-a1e9-eedb5db11231 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:40.471398 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-932dbab6-c64d-4617-a1e9-eedb5db11231 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:40.519433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] validate_networks() for [('3bd7028d-1af5-4df0-a72b-3e547cce0e83', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:12:40.602267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-932dbab6-c64d-4617-a1e9-eedb5db11231 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:40.611586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-932dbab6-c64d-4617-a1e9-eedb5db11231 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.153797 Jun 30 13:12:40.612318 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 339/674] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:40 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:40.897418 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:12:40.897910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:12:40.898676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:12:40.899276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:12:40.899847 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:12:40.914982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:40.915597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:40.916760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:40.917365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:40.935057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Getting quotas for project cee8ced67bdf4b5ca8aa12a8940b9bea. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:12:40.936629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:40.940358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Getting quotas for user e5e99d5484594d13b113f27e77b37efd and project cee8ced67bdf4b5ca8aa12a8940b9bea. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:12:40.954301 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:12:40.956628 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:12:41.013753 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8ed680b4-9f23-489b-bd60-add4712f5a8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.616840 Jun 30 13:12:41.014429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 336/675] 10.222.0.49 () {62 vars in 1187 bytes} [Thu Jun 30 13:12:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 13:12:41.024722 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-70320c4c-9b90-4ad5-8b28-4d1bf0253798 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:41.025323 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-70320c4c-9b90-4ad5-8b28-4d1bf0253798 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:41.078695 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-70320c4c-9b90-4ad5-8b28-4d1bf0253798 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:41.086467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-70320c4c-9b90-4ad5-8b28-4d1bf0253798 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:41.088194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-70320c4c-9b90-4ad5-8b28-4d1bf0253798 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:41.089660 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-70320c4c-9b90-4ad5-8b28-4d1bf0253798 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1280 microversion: 2.20 time: 0.068786 Jun 30 13:12:41.090282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 340/676] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:41 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:41.633620 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e07f5956-8085-4be2-8079-b22e6dc469dc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:41.634674 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e07f5956-8085-4be2-8079-b22e6dc469dc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:41.643649 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e07f5956-8085-4be2-8079-b22e6dc469dc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:41.644096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e07f5956-8085-4be2-8079-b22e6dc469dc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:41.644853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e07f5956-8085-4be2-8079-b22e6dc469dc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:41.645288 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e07f5956-8085-4be2-8079-b22e6dc469dc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:41.777750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e07f5956-8085-4be2-8079-b22e6dc469dc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:41.788981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e07f5956-8085-4be2-8079-b22e6dc469dc tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.162650 Jun 30 13:12:41.789746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 337/677] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:41 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:42.112522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:42.113513 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:42.127329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:42.127770 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:42.128525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:42.128944 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:42.201413 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:42.210103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:42.211619 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:42.212709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2ed2e19-bddf-4aa8-9e8c-53944824542f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1284 microversion: 2.20 time: 0.106789 Jun 30 13:12:42.213264 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 341/678] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:42 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:42.808286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2d350ff1-a120-4ade-b869-da3c05cb4805 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:42.808893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2d350ff1-a120-4ade-b869-da3c05cb4805 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:42.816239 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2d350ff1-a120-4ade-b869-da3c05cb4805 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:42.816638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2d350ff1-a120-4ade-b869-da3c05cb4805 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:42.817404 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2d350ff1-a120-4ade-b869-da3c05cb4805 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:42.817950 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2d350ff1-a120-4ade-b869-da3c05cb4805 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:42.998669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2d350ff1-a120-4ade-b869-da3c05cb4805 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:43.002080 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:43.006792 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2d350ff1-a120-4ade-b869-da3c05cb4805 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.202471 Jun 30 13:12:43.007411 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 338/679] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:42 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:43.231029 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:43.231760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:43.238826 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:43.239266 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:43.240024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:43.240446 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:43.303432 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:43.313894 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:43.315430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:43.316562 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8ce40a5c-122a-491c-befe-094f059e1c71 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1332 microversion: 2.20 time: 0.089503 Jun 30 13:12:43.332209 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 342/680] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:43 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:44.026255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-55b8180c-1dab-45fd-a5ef-97fadf7a3863 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:44.026976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-55b8180c-1dab-45fd-a5ef-97fadf7a3863 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:44.034377 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55b8180c-1dab-45fd-a5ef-97fadf7a3863 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:44.034844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55b8180c-1dab-45fd-a5ef-97fadf7a3863 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:44.035616 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55b8180c-1dab-45fd-a5ef-97fadf7a3863 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:44.036021 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55b8180c-1dab-45fd-a5ef-97fadf7a3863 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:44.178053 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-55b8180c-1dab-45fd-a5ef-97fadf7a3863 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:44.188311 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-55b8180c-1dab-45fd-a5ef-97fadf7a3863 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.167391 Jun 30 13:12:44.189115 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 339/681] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:44 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:44.341394 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:44.343221 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:44.351035 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:44.351614 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:44.352526 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:44.353057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:44.588930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:44.598306 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:44.600125 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:44.601998 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6120480d-40a4-4ea6-b320-befd5bbf3fc7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1406 microversion: 2.20 time: 0.266438 Jun 30 13:12:44.603065 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 343/682] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:44 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:44.950480 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-52e5f82d-4430-4ff5-bace-80a3de031d47 req-c1f0975e-8411-4697-935d-14035c1ddbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9860955c-dc0e-4b24-b696-9de9453da561", "tag": "4a99638e-5bc5-455f-b4cc-97801113ceea"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:44.960022 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-52e5f82d-4430-4ff5-bace-80a3de031d47 req-c1f0975e-8411-4697-935d-14035c1ddbc2 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:44.960720 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-52e5f82d-4430-4ff5-bace-80a3de031d47 req-c1f0975e-8411-4697-935d-14035c1ddbc2 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:44.978363 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-52e5f82d-4430-4ff5-bace-80a3de031d47 req-c1f0975e-8411-4697-935d-14035c1ddbc2 service nova] Creating event network-changed:4a99638e-5bc5-455f-b4cc-97801113ceea for instance 9860955c-dc0e-4b24-b696-9de9453da561 on hv-cinder-81268 Jun 30 13:12:44.984250 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-52e5f82d-4430-4ff5-bace-80a3de031d47 req-c1f0975e-8411-4697-935d-14035c1ddbc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039498 Jun 30 13:12:44.984925 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 340/683] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:12:45.205490 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-83b54987-f937-4977-84d1-d25711b81ac0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:45.206098 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-83b54987-f937-4977-84d1-d25711b81ac0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:45.212633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83b54987-f937-4977-84d1-d25711b81ac0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:45.213079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83b54987-f937-4977-84d1-d25711b81ac0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:45.213925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83b54987-f937-4977-84d1-d25711b81ac0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:45.214314 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-83b54987-f937-4977-84d1-d25711b81ac0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:45.452773 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-83b54987-f937-4977-84d1-d25711b81ac0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:45.461199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-83b54987-f937-4977-84d1-d25711b81ac0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.259798 Jun 30 13:12:45.462103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 344/684] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:45 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:45.625361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:45.626066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:45.632782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:45.633214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:45.633974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:45.634435 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:45.762448 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:45.770632 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:45.772104 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:45.773194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d7ecbe55-faa6-46b6-83bc-2199abc6faaa tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1406 microversion: 2.20 time: 0.153035 Jun 30 13:12:45.773745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 341/685] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:45 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:46.482955 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-74c01f46-ed2f-48a7-9263-99a91fc623fb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:46.483691 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-74c01f46-ed2f-48a7-9263-99a91fc623fb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:46.490983 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74c01f46-ed2f-48a7-9263-99a91fc623fb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:46.491445 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74c01f46-ed2f-48a7-9263-99a91fc623fb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:46.492237 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74c01f46-ed2f-48a7-9263-99a91fc623fb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:46.492685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74c01f46-ed2f-48a7-9263-99a91fc623fb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:46.626674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74c01f46-ed2f-48a7-9263-99a91fc623fb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:46.634494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-74c01f46-ed2f-48a7-9263-99a91fc623fb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.158165 Jun 30 13:12:46.635073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 345/686] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:46 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:46.798085 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:46.798812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:46.811498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:46.811938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:46.812697 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:46.813117 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:46.954547 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:46.967803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:46.972514 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:46.974473 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a08e66f3-9c51-4166-b4d9-8ee0c60bed00 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1406 microversion: 2.20 time: 0.181128 Jun 30 13:12:46.975373 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 342/687] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:46 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:47.026652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-533eba74-78d7-4c93-9ca1-62c72adabc19 req-d5b0ca89-94d0-4887-9a9b-45a925538b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c42415-7a22-43a3-a838-5bf551bec846", "name": "network-vif-plugged", "status": "completed", "tag": "39420333-9a35-4720-af7e-4064bfe6cdd7"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:47.035765 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-533eba74-78d7-4c93-9ca1-62c72adabc19 req-d5b0ca89-94d0-4887-9a9b-45a925538b21 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:47.035765 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-533eba74-78d7-4c93-9ca1-62c72adabc19 req-d5b0ca89-94d0-4887-9a9b-45a925538b21 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:47.046108 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-533eba74-78d7-4c93-9ca1-62c72adabc19 req-d5b0ca89-94d0-4887-9a9b-45a925538b21 service nova] Creating event network-vif-plugged:39420333-9a35-4720-af7e-4064bfe6cdd7 for instance 74c42415-7a22-43a3-a838-5bf551bec846 on hv-cinder-81268 Jun 30 13:12:47.050950 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-533eba74-78d7-4c93-9ca1-62c72adabc19 req-d5b0ca89-94d0-4887-9a9b-45a925538b21 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098751 Jun 30 13:12:47.051497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 346/688] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:12:47.651795 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8a36702c-68de-4b4a-97c9-afa5eb17a0a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:47.652414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8a36702c-68de-4b4a-97c9-afa5eb17a0a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:47.658890 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8a36702c-68de-4b4a-97c9-afa5eb17a0a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:47.659320 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8a36702c-68de-4b4a-97c9-afa5eb17a0a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:47.660055 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8a36702c-68de-4b4a-97c9-afa5eb17a0a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:47.660471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8a36702c-68de-4b4a-97c9-afa5eb17a0a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:47.792760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8a36702c-68de-4b4a-97c9-afa5eb17a0a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:47.800558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8a36702c-68de-4b4a-97c9-afa5eb17a0a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.152741 Jun 30 13:12:47.801141 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 343/689] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:47 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:48.010999 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:48.013370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:48.021355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:48.021786 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:48.022591 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:48.023014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:48.222586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:48.230641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:48.232114 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:48.233393 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db313339-a07f-4e27-ab79-b8adfbddb02d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1406 microversion: 2.20 time: 0.230611 Jun 30 13:12:48.233819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 347/690] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:47 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:48.817976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-434906d1-2281-4240-b5d5-86be11a60618 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:48.818705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-434906d1-2281-4240-b5d5-86be11a60618 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:48.825632 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-434906d1-2281-4240-b5d5-86be11a60618 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:48.826073 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-434906d1-2281-4240-b5d5-86be11a60618 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:48.826878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-434906d1-2281-4240-b5d5-86be11a60618 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:48.827686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-434906d1-2281-4240-b5d5-86be11a60618 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:48.963022 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-434906d1-2281-4240-b5d5-86be11a60618 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:48.971861 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-434906d1-2281-4240-b5d5-86be11a60618 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1367 microversion: 2.1 time: 0.157905 Jun 30 13:12:48.972441 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 344/691] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:48 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:49.254798 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:49.255692 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:49.267172 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:49.267900 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:49.269191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:49.269916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:49.476419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:49.479966 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:49.485736 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:49.487273 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:49.488386 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e100c668-78a2-43a2-8e91-433db8916572 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1406 microversion: 2.20 time: 0.240363 Jun 30 13:12:49.489153 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 348/692] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:49 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:49.993102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b2deae56-ad79-471b-ae2c-2cb15a436efe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:49.994052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b2deae56-ad79-471b-ae2c-2cb15a436efe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:50.003543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b2deae56-ad79-471b-ae2c-2cb15a436efe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:50.003985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b2deae56-ad79-471b-ae2c-2cb15a436efe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:50.004732 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b2deae56-ad79-471b-ae2c-2cb15a436efe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:50.005150 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b2deae56-ad79-471b-ae2c-2cb15a436efe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:50.148920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b2deae56-ad79-471b-ae2c-2cb15a436efe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:50.156612 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b2deae56-ad79-471b-ae2c-2cb15a436efe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1558 microversion: 2.1 time: 0.170122 Jun 30 13:12:50.157186 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 345/693] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:12:49 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:12:50.174247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5d476aeb-8c8d-43c7-a17b-7d203f58e047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:50.174780 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5d476aeb-8c8d-43c7-a17b-7d203f58e047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:50.181474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d476aeb-8c8d-43c7-a17b-7d203f58e047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:50.181917 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d476aeb-8c8d-43c7-a17b-7d203f58e047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:50.182719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d476aeb-8c8d-43c7-a17b-7d203f58e047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:50.183148 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5d476aeb-8c8d-43c7-a17b-7d203f58e047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:50.267303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5d476aeb-8c8d-43c7-a17b-7d203f58e047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097936 Jun 30 13:12:50.268653 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 349/694] 10.222.0.49 () {58 vars in 1274 bytes} [Thu Jun 30 13:12:50 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:50.507846 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:50.508635 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:50.517723 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:50.518158 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:50.519192 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:50.520129 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:50.800036 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:50.810137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:50.811679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:50.812866 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7cc6b828-0730-4f66-8f49-8f7afa8a42fc tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1406 microversion: 2.20 time: 0.310652 Jun 30 13:12:50.813429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 346/695] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:50 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:12:50.966912 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-38517803-2d0f-4324-801b-a6950a665f93 req-219075cc-ab5c-4f05-b5b1-27c98ab2abfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9860955c-dc0e-4b24-b696-9de9453da561", "name": "network-vif-plugged", "status": "completed", "tag": "4a99638e-5bc5-455f-b4cc-97801113ceea"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:50.976726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38517803-2d0f-4324-801b-a6950a665f93 req-219075cc-ab5c-4f05-b5b1-27c98ab2abfc service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:50.977118 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-38517803-2d0f-4324-801b-a6950a665f93 req-219075cc-ab5c-4f05-b5b1-27c98ab2abfc service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:50.989530 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-38517803-2d0f-4324-801b-a6950a665f93 req-219075cc-ab5c-4f05-b5b1-27c98ab2abfc service nova] Creating event network-vif-plugged:4a99638e-5bc5-455f-b4cc-97801113ceea for instance 9860955c-dc0e-4b24-b696-9de9453da561 on hv-cinder-81268 Jun 30 13:12:50.995069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-38517803-2d0f-4324-801b-a6950a665f93 req-219075cc-ab5c-4f05-b5b1-27c98ab2abfc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031879 Jun 30 13:12:50.995680 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 350/696] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:51.289868 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-1207c4f8-3efe-43bf-aaa5-07db81bd622c req-31459a9d-28d0-4990-ae74-e6ca6364fbcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c42415-7a22-43a3-a838-5bf551bec846", "tag": "39420333-9a35-4720-af7e-4064bfe6cdd7"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:51.293429 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=4 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:51.294100 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=12 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:51.301477 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-1207c4f8-3efe-43bf-aaa5-07db81bd622c req-31459a9d-28d0-4990-ae74-e6ca6364fbcf service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:51.301850 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-1207c4f8-3efe-43bf-aaa5-07db81bd622c req-31459a9d-28d0-4990-ae74-e6ca6364fbcf service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:51.317264 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-1207c4f8-3efe-43bf-aaa5-07db81bd622c req-31459a9d-28d0-4990-ae74-e6ca6364fbcf service nova] Creating event network-changed:39420333-9a35-4720-af7e-4064bfe6cdd7 for instance 74c42415-7a22-43a3-a838-5bf551bec846 on hv-cinder-81268 Jun 30 13:12:51.322278 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-1207c4f8-3efe-43bf-aaa5-07db81bd622c req-31459a9d-28d0-4990-ae74-e6ca6364fbcf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036082 Jun 30 13:12:51.322911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 347/697] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:12:51.828837 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=12 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:51.835343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:51.836037 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:51.842630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:51.843465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:51.844224 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:51.844639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:51.977225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:51.985361 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:51.986878 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:51.987986 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f9ed6dc6-8705-4285-9aff-5d6b1b104eb4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1406 microversion: 2.20 time: 0.160231 Jun 30 13:12:51.988560 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 351/698] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:51 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:12:53.007468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:53.008032 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:53.014743 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:53.015172 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:53.016402 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:53.016820 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:53.158125 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:53.166722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:53.168189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:12:53.169332 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e90c653d-075f-4f27-9419-e74f6a94f70b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1597 microversion: 2.20 time: 0.166913 Jun 30 13:12:53.169858 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 348/699] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:12:53 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:12:53.190499 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c0a02e78-6349-4c16-85fb-cda6f8c35b8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:12:53.191011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c0a02e78-6349-4c16-85fb-cda6f8c35b8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:12:53.194367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:12:53.199955 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0a02e78-6349-4c16-85fb-cda6f8c35b8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:53.200406 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0a02e78-6349-4c16-85fb-cda6f8c35b8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:53.201182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0a02e78-6349-4c16-85fb-cda6f8c35b8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:53.201602 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c0a02e78-6349-4c16-85fb-cda6f8c35b8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:53.285421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c0a02e78-6349-4c16-85fb-cda6f8c35b8e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101739 Jun 30 13:12:53.286018 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 352/700] 10.222.0.49 () {60 vars in 1315 bytes} [Thu Jun 30 13:12:53 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 13:12:54.284158 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-afe7e67a-2967-4c74-836e-0c4fc31896fe req-f6de10b9-fb0d-4761-8608-6e0aba9995c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9860955c-dc0e-4b24-b696-9de9453da561", "tag": "4a99638e-5bc5-455f-b4cc-97801113ceea"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:12:54.292815 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-afe7e67a-2967-4c74-836e-0c4fc31896fe req-f6de10b9-fb0d-4761-8608-6e0aba9995c1 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:12:54.293245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-afe7e67a-2967-4c74-836e-0c4fc31896fe req-f6de10b9-fb0d-4761-8608-6e0aba9995c1 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:12:54.304413 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-afe7e67a-2967-4c74-836e-0c4fc31896fe req-f6de10b9-fb0d-4761-8608-6e0aba9995c1 service nova] Creating event network-changed:4a99638e-5bc5-455f-b4cc-97801113ceea for instance 9860955c-dc0e-4b24-b696-9de9453da561 on hv-cinder-81268 Jun 30 13:12:54.309620 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-afe7e67a-2967-4c74-836e-0c4fc31896fe req-f6de10b9-fb0d-4761-8608-6e0aba9995c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029200 Jun 30 13:12:54.310383 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 349/701] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:24.402776 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=16 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:24.403573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:24.408248 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2334e60-e156-479d-bced-00138a1da472 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:24.409235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2334e60-e156-479d-bced-00138a1da472 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:24.416299 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2334e60-e156-479d-bced-00138a1da472 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:24.416740 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2334e60-e156-479d-bced-00138a1da472 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:24.417758 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2334e60-e156-479d-bced-00138a1da472 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:24.418289 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2334e60-e156-479d-bced-00138a1da472 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:24.447989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2334e60-e156-479d-bced-00138a1da472 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047424 Jun 30 13:13:24.448774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 353/702] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:13:24 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:13:24.516745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-20d1e678-805d-46e5-9917-79617215fb44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:24.517265 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-20d1e678-805d-46e5-9917-79617215fb44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:24.519602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:24.520292 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=54 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:24.526610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20d1e678-805d-46e5-9917-79617215fb44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:24.527303 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20d1e678-805d-46e5-9917-79617215fb44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:24.527781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20d1e678-805d-46e5-9917-79617215fb44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:24.528206 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20d1e678-805d-46e5-9917-79617215fb44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:24.554211 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-20d1e678-805d-46e5-9917-79617215fb44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:13:24.638221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-20d1e678-805d-46e5-9917-79617215fb44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 204 len: 0 microversion: 2.1 time: 0.125478 Jun 30 13:13:24.638835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 350/703] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:13:24 2022] DELETE /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:13:24.648010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a3e931c7-5e6b-4854-9afd-902b753f18fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:24.648632 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a3e931c7-5e6b-4854-9afd-902b753f18fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:24.657400 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3e931c7-5e6b-4854-9afd-902b753f18fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:24.658040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3e931c7-5e6b-4854-9afd-902b753f18fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:24.659009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3e931c7-5e6b-4854-9afd-902b753f18fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:24.659535 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a3e931c7-5e6b-4854-9afd-902b753f18fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:24.803041 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a3e931c7-5e6b-4854-9afd-902b753f18fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:24.811609 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a3e931c7-5e6b-4854-9afd-902b753f18fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1673 microversion: 2.1 time: 0.167981 Jun 30 13:13:24.812200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 354/704] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:24 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:25.834925 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d1fb35d4-bcbf-4d10-9a80-bd53cd8a9b2b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:25.836189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d1fb35d4-bcbf-4d10-9a80-bd53cd8a9b2b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:25.848358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d1fb35d4-bcbf-4d10-9a80-bd53cd8a9b2b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:25.849090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d1fb35d4-bcbf-4d10-9a80-bd53cd8a9b2b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:25.850533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d1fb35d4-bcbf-4d10-9a80-bd53cd8a9b2b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:25.851276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d1fb35d4-bcbf-4d10-9a80-bd53cd8a9b2b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:25.851778 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ff9e2310-60d6-4f98-83b4-c01f004c9410 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:25.852947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ff9e2310-60d6-4f98-83b4-c01f004c9410 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:25.861581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff9e2310-60d6-4f98-83b4-c01f004c9410 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:25.862121 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff9e2310-60d6-4f98-83b4-c01f004c9410 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:25.863004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff9e2310-60d6-4f98-83b4-c01f004c9410 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:25.863415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ff9e2310-60d6-4f98-83b4-c01f004c9410 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:25.887160 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-ff9e2310-60d6-4f98-83b4-c01f004c9410 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lazy-loading 'flavor' on Instance uuid 6237f937-32a4-40da-aebc-6bc1311b08a4 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:13:25.967173 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ff9e2310-60d6-4f98-83b4-c01f004c9410 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "POST /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4/action" status: 202 len: 0 microversion: 2.1 time: 0.122340 Jun 30 13:13:25.968017 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 355/705] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:13:25 2022] POST /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:13:25.977179 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c8c92b5-199a-4a54-8be6-fb6732ee1029 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:25.978216 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c8c92b5-199a-4a54-8be6-fb6732ee1029 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:25.985898 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c8c92b5-199a-4a54-8be6-fb6732ee1029 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:25.986735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c8c92b5-199a-4a54-8be6-fb6732ee1029 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:25.987690 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c8c92b5-199a-4a54-8be6-fb6732ee1029 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:25.988312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c8c92b5-199a-4a54-8be6-fb6732ee1029 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:25.992057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d1fb35d4-bcbf-4d10-9a80-bd53cd8a9b2b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:26.000183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d1fb35d4-bcbf-4d10-9a80-bd53cd8a9b2b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1673 microversion: 2.1 time: 0.172782 Jun 30 13:13:26.000759 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 351/706] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:25 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:26.132117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6c8c92b5-199a-4a54-8be6-fb6732ee1029 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:26.141080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c8c92b5-199a-4a54-8be6-fb6732ee1029 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.168168 Jun 30 13:13:26.141661 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 356/707] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:25 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:26.222183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-004c0678-4206-4bfb-af27-b9cc073b7a67 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:26.222183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-004c0678-4206-4bfb-af27-b9cc073b7a67 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:26.228214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-004c0678-4206-4bfb-af27-b9cc073b7a67 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:26.228646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-004c0678-4206-4bfb-af27-b9cc073b7a67 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:26.229383 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-004c0678-4206-4bfb-af27-b9cc073b7a67 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:26.230181 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-004c0678-4206-4bfb-af27-b9cc073b7a67 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:26.320959 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-004c0678-4206-4bfb-af27-b9cc073b7a67 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lazy-loading 'services' on Instance uuid 9d58b08a-c2ee-4f45-90c0-400b9e677939 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:13:26.401284 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-004c0678-4206-4bfb-af27-b9cc073b7a67 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments/11e92339-2224-4deb-a806-a813eff4d326" status: 202 len: 0 microversion: 2.1 time: 0.184412 Jun 30 13:13:26.402057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 352/708] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:13:26 2022] DELETE /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments/11e92339-2224-4deb-a806-a813eff4d326 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 13:13:26.410577 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a2c3439e-da81-4342-8e7b-50e998c9eb11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:26.411572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a2c3439e-da81-4342-8e7b-50e998c9eb11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:26.418940 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2c3439e-da81-4342-8e7b-50e998c9eb11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:26.419381 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2c3439e-da81-4342-8e7b-50e998c9eb11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:26.420218 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2c3439e-da81-4342-8e7b-50e998c9eb11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:26.420642 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a2c3439e-da81-4342-8e7b-50e998c9eb11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:26.451371 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a2c3439e-da81-4342-8e7b-50e998c9eb11 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044716 Jun 30 13:13:26.451986 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 357/709] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:13:26 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:27.017953 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-eee4fe15-be1e-4ef2-9dd1-c26e135a4961 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:27.018850 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-eee4fe15-be1e-4ef2-9dd1-c26e135a4961 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:27.025960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eee4fe15-be1e-4ef2-9dd1-c26e135a4961 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:27.026409 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eee4fe15-be1e-4ef2-9dd1-c26e135a4961 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:27.027252 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eee4fe15-be1e-4ef2-9dd1-c26e135a4961 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:27.033341 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-eee4fe15-be1e-4ef2-9dd1-c26e135a4961 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:27.116867 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-eee4fe15-be1e-4ef2-9dd1-c26e135a4961 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:27.126272 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-eee4fe15-be1e-4ef2-9dd1-c26e135a4961 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 200 len: 1606 microversion: 2.1 time: 0.112473 Jun 30 13:13:27.127679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 353/710] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:27 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 1606 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:27.150227 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-79139039-c839-47fe-b4c1-5cd88884467a req-fa2fd5a2-0117-412f-8268-d70a1a6ffcf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfaf5f03-a265-481f-81c5-2f4432079c41", "name": "network-vif-deleted", "tag": "3af06866-5ee3-41a6-97e5-30ef336cf968"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:27.163410 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-79139039-c839-47fe-b4c1-5cd88884467a req-fa2fd5a2-0117-412f-8268-d70a1a6ffcf9 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:27.167196 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-79139039-c839-47fe-b4c1-5cd88884467a req-fa2fd5a2-0117-412f-8268-d70a1a6ffcf9 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:27.168375 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f26467fd-eabb-47b9-9668-b1fba5986cca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:27.169399 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f26467fd-eabb-47b9-9668-b1fba5986cca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:27.186752 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-79139039-c839-47fe-b4c1-5cd88884467a req-fa2fd5a2-0117-412f-8268-d70a1a6ffcf9 service nova] Creating event network-vif-deleted:3af06866-5ee3-41a6-97e5-30ef336cf968 for instance bfaf5f03-a265-481f-81c5-2f4432079c41 on hv-cinder-81268 Jun 30 13:13:27.188072 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f26467fd-eabb-47b9-9668-b1fba5986cca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:27.189266 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f26467fd-eabb-47b9-9668-b1fba5986cca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:27.191084 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f26467fd-eabb-47b9-9668-b1fba5986cca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:27.192281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f26467fd-eabb-47b9-9668-b1fba5986cca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:27.200454 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-79139039-c839-47fe-b4c1-5cd88884467a req-fa2fd5a2-0117-412f-8268-d70a1a6ffcf9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058037 Jun 30 13:13:27.206243 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 358/711] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:27.373943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f26467fd-eabb-47b9-9668-b1fba5986cca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:27.384317 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f26467fd-eabb-47b9-9668-b1fba5986cca tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.229541 Jun 30 13:13:27.384991 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 354/712] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:27 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:27.463782 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6aef2239-20b3-49a2-89ec-50ec703a7e50 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:27.464930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6aef2239-20b3-49a2-89ec-50ec703a7e50 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:27.471871 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6aef2239-20b3-49a2-89ec-50ec703a7e50 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:27.472306 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6aef2239-20b3-49a2-89ec-50ec703a7e50 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:27.473069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6aef2239-20b3-49a2-89ec-50ec703a7e50 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:27.473487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6aef2239-20b3-49a2-89ec-50ec703a7e50 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:27.505978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6aef2239-20b3-49a2-89ec-50ec703a7e50 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046517 Jun 30 13:13:27.506577 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 359/713] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:13:27 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:28.144200 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:28.144818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:28.152000 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.152439 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.153200 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.153618 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.168148 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] HTTP exception thrown: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Request method failure captured: Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 HTTP/1.1 Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-2SOjfoQz0uAeE5VNJ8r17gmOfJQPMhA6ywZGx26FCBHzEe44jjfDb1y53FhcnNyxDOZxBzqjwdGhPfEfrD7LsU5O34l5tIvVBX5ttaUVBf3HzJA7K_OXD3MyxASuOySYnhyQFUtIA15wroph0co_tYMVJccM-P3P33Bpg3S_oN0U Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:13:28.169818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}] Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: e0df4b789a804a00a267bcc5cf778324 Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:13:28.171262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': 'bfaf5f03-a265-481f-81c5-2f4432079c41'} Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:13:28.172731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:13:28.174081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:28.176695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Returning 404 to user: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:13:28.176695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-50456f27-6633-4e32-9ed1-58a3537986c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 404 len: 111 microversion: 2.1 time: 0.031007 Jun 30 13:13:28.176695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 355/714] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:28 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:13:28.180320 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b79fee29-70c1-4e3b-aba0-e5b96bd23f83 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '.version_select at 0x7f4b9ffefaf0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:28.199739 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b79fee29-70c1-4e3b-aba0-e5b96bd23f83 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093773867" status: 202 len: 0 microversion: 2.1 time: 0.023206 Jun 30 13:13:28.200318 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 360/715] 10.222.0.49 () {58 vars in 1220 bytes} [Thu Jun 30 13:13:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093773867 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:13:28.401423 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d13e405f-b4bc-4d67-94ae-dce6996d099e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:28.402060 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d13e405f-b4bc-4d67-94ae-dce6996d099e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:28.408355 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d13e405f-b4bc-4d67-94ae-dce6996d099e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.408795 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d13e405f-b4bc-4d67-94ae-dce6996d099e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.409551 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d13e405f-b4bc-4d67-94ae-dce6996d099e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.409974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d13e405f-b4bc-4d67-94ae-dce6996d099e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.520424 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-353a2451-f639-4bc6-889f-6e4f4c3ac322 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:28.521484 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-353a2451-f639-4bc6-889f-6e4f4c3ac322 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:28.528978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353a2451-f639-4bc6-889f-6e4f4c3ac322 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.529498 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353a2451-f639-4bc6-889f-6e4f4c3ac322 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.530354 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353a2451-f639-4bc6-889f-6e4f4c3ac322 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.530845 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-353a2451-f639-4bc6-889f-6e4f4c3ac322 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.548229 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d13e405f-b4bc-4d67-94ae-dce6996d099e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:28.555846 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d13e405f-b4bc-4d67-94ae-dce6996d099e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.158402 Jun 30 13:13:28.557056 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 356/716] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:28 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:28.560649 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-353a2451-f639-4bc6-889f-6e4f4c3ac322 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044573 Jun 30 13:13:28.561190 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 361/717] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:13:28 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:13:28.632209 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5aaa2fa1-ba61-4d73-b986-da31e0085f9b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:28.632693 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5aaa2fa1-ba61-4d73-b986-da31e0085f9b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:28.638778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5aaa2fa1-ba61-4d73-b986-da31e0085f9b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.639211 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5aaa2fa1-ba61-4d73-b986-da31e0085f9b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.639958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5aaa2fa1-ba61-4d73-b986-da31e0085f9b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.640377 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5aaa2fa1-ba61-4d73-b986-da31e0085f9b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.665158 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5aaa2fa1-ba61-4d73-b986-da31e0085f9b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:13:28.749261 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5aaa2fa1-ba61-4d73-b986-da31e0085f9b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 204 len: 0 microversion: 2.1 time: 0.120548 Jun 30 13:13:28.754638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 357/718] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:13:28 2022] DELETE /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:13:28.760565 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ce3b2815-3649-45d7-abc6-992581ccf093 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:28.761686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ce3b2815-3649-45d7-abc6-992581ccf093 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:28.769013 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce3b2815-3649-45d7-abc6-992581ccf093 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.769539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce3b2815-3649-45d7-abc6-992581ccf093 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.770403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce3b2815-3649-45d7-abc6-992581ccf093 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:28.770891 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ce3b2815-3649-45d7-abc6-992581ccf093 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:28.886304 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7cff2280-4098-4bf4-9789-4efb78058819 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'create', calling method: .version_select at 0x7f4ba404ff70>, body: {"keypair": {"name": "tempest-keypair-639750864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNVpaMNbjJ6ey3vvqQzjhT8OAPTV/Q4sQrlcMctOz8ndUPoC2CmgB3Q7u4LBvemxmwxjm3jVJF0Gd5f1Fq/4lhNcjTkRZ2U7ZZsXsrykPVX9eP98ia6EyCzywZZU/Yujw=="}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:28.901198 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-7cff2280-4098-4bf4-9789-4efb78058819 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Getting quotas for project 2671e576de2c44e6b1f5df7c53aae76a. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:13:28.905424 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-7cff2280-4098-4bf4-9789-4efb78058819 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Getting quotas for user e0df4b789a804a00a267bcc5cf778324 and project 2671e576de2c44e6b1f5df7c53aae76a. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:13:28.923303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ce3b2815-3649-45d7-abc6-992581ccf093 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:28.931275 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7cff2280-4098-4bf4-9789-4efb78058819 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049297 Jun 30 13:13:28.932092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 358/719] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:13:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:28.932217 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ce3b2815-3649-45d7-abc6-992581ccf093 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1687 microversion: 2.1 time: 0.177104 Jun 30 13:13:28.932483 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 362/720] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:28 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:13:29.574367 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-571bab76-c893-4233-b0ad-c9ec078ef5a7 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:29.575091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-571bab76-c893-4233-b0ad-c9ec078ef5a7 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:29.582145 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-571bab76-c893-4233-b0ad-c9ec078ef5a7 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:29.582635 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-571bab76-c893-4233-b0ad-c9ec078ef5a7 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:29.583428 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-571bab76-c893-4233-b0ad-c9ec078ef5a7 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:29.583848 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-571bab76-c893-4233-b0ad-c9ec078ef5a7 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:29.765571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-571bab76-c893-4233-b0ad-c9ec078ef5a7 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:29.773778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-571bab76-c893-4233-b0ad-c9ec078ef5a7 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.204274 Jun 30 13:13:29.774425 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 359/721] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:29 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:29.948741 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8e266b1-a00a-4de2-ba0f-cac5c6d0da17 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:29.949382 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c8e266b1-a00a-4de2-ba0f-cac5c6d0da17 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:29.956027 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8e266b1-a00a-4de2-ba0f-cac5c6d0da17 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:29.956458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8e266b1-a00a-4de2-ba0f-cac5c6d0da17 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:29.957249 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8e266b1-a00a-4de2-ba0f-cac5c6d0da17 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:29.957659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8e266b1-a00a-4de2-ba0f-cac5c6d0da17 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:30.087639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c8e266b1-a00a-4de2-ba0f-cac5c6d0da17 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:30.096899 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c8e266b1-a00a-4de2-ba0f-cac5c6d0da17 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1687 microversion: 2.1 time: 0.151982 Jun 30 13:13:30.097509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 363/722] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:29 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:30.263116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-412110421", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98947936-447b-42a6-83b5-89edd13aec37"}], "security_groups": [{"name": "tempest-securitygroup--1846102788"}], "key_name": "tempest-keypair-639750864", "user_data": "}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:30.371301 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] validate_networks() for [('98947936-447b-42a6-83b5-89edd13aec37', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:13:30.767969 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:13:30.768555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:13:30.768816 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:13:30.769217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:13:30.769614 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:13:30.779386 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:30.779827 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:30.780610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:30.781089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:30.790936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-26e67ba7-4843-478f-b319-b902ce12dc85 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:30.792360 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-26e67ba7-4843-478f-b319-b902ce12dc85 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:30.799156 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26e67ba7-4843-478f-b319-b902ce12dc85 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:30.799315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Getting quotas for project 2671e576de2c44e6b1f5df7c53aae76a. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:13:30.800345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26e67ba7-4843-478f-b319-b902ce12dc85 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:30.801940 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26e67ba7-4843-478f-b319-b902ce12dc85 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:30.802827 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-26e67ba7-4843-478f-b319-b902ce12dc85 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:30.803557 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Getting quotas for user e0df4b789a804a00a267bcc5cf778324 and project 2671e576de2c44e6b1f5df7c53aae76a. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:13:30.815182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:13:30.817555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:13:30.880519 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e6e8c454-35fc-450e-be28-e93b3dea088f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621629 Jun 30 13:13:30.881186 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 360/723] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:13:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:13:30.893898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-51082b37-245e-4e67-a626-52dc7538c42a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:30.894540 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-51082b37-245e-4e67-a626-52dc7538c42a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:30.956317 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-51082b37-245e-4e67-a626-52dc7538c42a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:30.963332 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-51082b37-245e-4e67-a626-52dc7538c42a tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1236 microversion: 2.1 time: 0.074741 Jun 30 13:13:30.964130 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 361/724] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:30 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:30.997350 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-26e67ba7-4843-478f-b319-b902ce12dc85 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:31.005821 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-26e67ba7-4843-478f-b319-b902ce12dc85 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.218674 Jun 30 13:13:31.016224 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 364/725] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:30 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:31.114195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5225a352-610f-4d6f-9cd7-fad4ebef0b19 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:31.114830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5225a352-610f-4d6f-9cd7-fad4ebef0b19 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:31.121509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5225a352-610f-4d6f-9cd7-fad4ebef0b19 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:31.121946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5225a352-610f-4d6f-9cd7-fad4ebef0b19 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:31.122743 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5225a352-610f-4d6f-9cd7-fad4ebef0b19 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:31.123166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5225a352-610f-4d6f-9cd7-fad4ebef0b19 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:31.256945 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5225a352-610f-4d6f-9cd7-fad4ebef0b19 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:31.263423 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5225a352-610f-4d6f-9cd7-fad4ebef0b19 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1687 microversion: 2.1 time: 0.153141 Jun 30 13:13:31.264016 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 362/726] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:31 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:31.981729 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c5f8f896-5a28-478d-a322-d5f8c61572ab tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:31.982426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c5f8f896-5a28-478d-a322-d5f8c61572ab tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:31.989959 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f8f896-5a28-478d-a322-d5f8c61572ab tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:31.990485 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f8f896-5a28-478d-a322-d5f8c61572ab tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:31.991315 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f8f896-5a28-478d-a322-d5f8c61572ab tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:31.991787 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c5f8f896-5a28-478d-a322-d5f8c61572ab tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:32.023204 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-791debe8-e599-4296-af91-bb8a21f8a5c3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:32.023879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-791debe8-e599-4296-af91-bb8a21f8a5c3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:32.031003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-791debe8-e599-4296-af91-bb8a21f8a5c3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:32.031538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-791debe8-e599-4296-af91-bb8a21f8a5c3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:32.032312 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-791debe8-e599-4296-af91-bb8a21f8a5c3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:32.032730 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-791debe8-e599-4296-af91-bb8a21f8a5c3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:32.060777 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c5f8f896-5a28-478d-a322-d5f8c61572ab tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:32.068356 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c5f8f896-5a28-478d-a322-d5f8c61572ab tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1240 microversion: 2.1 time: 0.091124 Jun 30 13:13:32.068924 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 365/727] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:31 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:32.170248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-791debe8-e599-4296-af91-bb8a21f8a5c3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:32.178378 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-791debe8-e599-4296-af91-bb8a21f8a5c3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.158920 Jun 30 13:13:32.179249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 363/728] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:32 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:32.281134 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09454452-5d66-4c90-bb54-ba33109f1355 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:32.281733 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09454452-5d66-4c90-bb54-ba33109f1355 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:32.288408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09454452-5d66-4c90-bb54-ba33109f1355 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:32.288848 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09454452-5d66-4c90-bb54-ba33109f1355 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:32.289594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09454452-5d66-4c90-bb54-ba33109f1355 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:32.290014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09454452-5d66-4c90-bb54-ba33109f1355 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:32.421026 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09454452-5d66-4c90-bb54-ba33109f1355 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:32.428816 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09454452-5d66-4c90-bb54-ba33109f1355 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1687 microversion: 2.1 time: 0.151544 Jun 30 13:13:32.429359 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 366/729] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:32 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:33.090362 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-77898c42-3469-43f9-9962-da16d7bce75f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:33.090977 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-77898c42-3469-43f9-9962-da16d7bce75f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:33.104276 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-77898c42-3469-43f9-9962-da16d7bce75f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:33.104768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-77898c42-3469-43f9-9962-da16d7bce75f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:33.105613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-77898c42-3469-43f9-9962-da16d7bce75f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:33.106075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-77898c42-3469-43f9-9962-da16d7bce75f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:33.194866 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-77898c42-3469-43f9-9962-da16d7bce75f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:33.197036 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-65eb69fe-13d5-41a8-a232-0182b821b2c0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:33.198415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-65eb69fe-13d5-41a8-a232-0182b821b2c0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:33.203445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-77898c42-3469-43f9-9962-da16d7bce75f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1296 microversion: 2.1 time: 0.121899 Jun 30 13:13:33.213479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 364/730] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:33 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:33.220567 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65eb69fe-13d5-41a8-a232-0182b821b2c0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:33.221009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65eb69fe-13d5-41a8-a232-0182b821b2c0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:33.221810 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65eb69fe-13d5-41a8-a232-0182b821b2c0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:33.222200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65eb69fe-13d5-41a8-a232-0182b821b2c0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:33.403145 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-65eb69fe-13d5-41a8-a232-0182b821b2c0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:33.411148 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-65eb69fe-13d5-41a8-a232-0182b821b2c0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.217930 Jun 30 13:13:33.411734 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 367/731] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:33 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:33.448028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bfacaebd-8cda-4de3-a03e-eb2502e43872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:33.449060 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bfacaebd-8cda-4de3-a03e-eb2502e43872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:33.455445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bfacaebd-8cda-4de3-a03e-eb2502e43872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:33.456162 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bfacaebd-8cda-4de3-a03e-eb2502e43872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:33.457175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bfacaebd-8cda-4de3-a03e-eb2502e43872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:33.457811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bfacaebd-8cda-4de3-a03e-eb2502e43872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:33.652009 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bfacaebd-8cda-4de3-a03e-eb2502e43872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:33.655937 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:33.660310 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bfacaebd-8cda-4de3-a03e-eb2502e43872 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 200 len: 1687 microversion: 2.1 time: 0.216158 Jun 30 13:13:33.661069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 365/732] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:33 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 1687 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:33.962138 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-f0dd6085-edfd-46bf-97cd-370516d0a10f req-1583610c-a5f1-4ab0-b2ea-dc6b5a1951fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d58b08a-c2ee-4f45-90c0-400b9e677939", "name": "network-vif-deleted", "tag": "f167dfd2-b19b-402d-b775-ccdceb0797f3"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:33.972146 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f0dd6085-edfd-46bf-97cd-370516d0a10f req-1583610c-a5f1-4ab0-b2ea-dc6b5a1951fb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:33.972863 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f0dd6085-edfd-46bf-97cd-370516d0a10f req-1583610c-a5f1-4ab0-b2ea-dc6b5a1951fb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:33.985781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-f0dd6085-edfd-46bf-97cd-370516d0a10f req-1583610c-a5f1-4ab0-b2ea-dc6b5a1951fb service nova] Creating event network-vif-deleted:f167dfd2-b19b-402d-b775-ccdceb0797f3 for instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 on hv-cinder-81268 Jun 30 13:13:33.991095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-f0dd6085-edfd-46bf-97cd-370516d0a10f req-1583610c-a5f1-4ab0-b2ea-dc6b5a1951fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032599 Jun 30 13:13:33.994750 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 368/733] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:34.221853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4a4673a3-5f2d-4b53-92a0-a8a9be93fc09 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:34.233388 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4a4673a3-5f2d-4b53-92a0-a8a9be93fc09 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:34.242350 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4a4673a3-5f2d-4b53-92a0-a8a9be93fc09 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:34.243089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4a4673a3-5f2d-4b53-92a0-a8a9be93fc09 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:34.244023 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4a4673a3-5f2d-4b53-92a0-a8a9be93fc09 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:34.244605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4a4673a3-5f2d-4b53-92a0-a8a9be93fc09 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:34.399672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4a4673a3-5f2d-4b53-92a0-a8a9be93fc09 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:34.409380 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4a4673a3-5f2d-4b53-92a0-a8a9be93fc09 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.191789 Jun 30 13:13:34.409998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 366/734] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:34 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:34.429685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-78c9547e-d0dc-4dd5-ba3a-5145f64a949d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:34.430398 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-78c9547e-d0dc-4dd5-ba3a-5145f64a949d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:34.437967 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78c9547e-d0dc-4dd5-ba3a-5145f64a949d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:34.438760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78c9547e-d0dc-4dd5-ba3a-5145f64a949d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:34.439981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78c9547e-d0dc-4dd5-ba3a-5145f64a949d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:34.440580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-78c9547e-d0dc-4dd5-ba3a-5145f64a949d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:34.654632 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-78c9547e-d0dc-4dd5-ba3a-5145f64a949d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:34.659305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:34.665423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-78c9547e-d0dc-4dd5-ba3a-5145f64a949d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.240534 Jun 30 13:13:34.666911 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 369/735] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:34 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:34.684812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:34.686544 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 9d58b08a-c2ee-4f45-90c0-400b9e677939] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:34.699083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:34.699663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:34.700830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:34.701264 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:34.724571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] HTTP exception thrown: Instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 could not be found. Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Request method failure captured: Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 HTTP/1.1 Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivaAIiDqmzBk003FXqe908sKplnTOTTe0uls5Nb8W8-zMdKmCsB-qpzXIvF9yYVYkb9yALsgVIgttIi01Upr8CXOW-00eiFTlAUMZr93waJwCoH1jb-eeAiJZG7ktMvlqrdytI7P28ZHMQbEezLOmyoqkbkEskw-g3MbLo0VWlZFO-ZE Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:13:34.726574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_792f217e834c4049b5b0d856cd53f947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}] Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: a7ce962e4a7447848e3454905102d27c Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 could not be found. Jun 30 13:13:34.728101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '9d58b08a-c2ee-4f45-90c0-400b9e677939'} Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 could not be found. Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:13:34.728958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 could not be found. Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 could not be found. Jun 30 13:13:34.730443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:34.732594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Returning 404 to user: Instance 9d58b08a-c2ee-4f45-90c0-400b9e677939 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:13:34.734127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c9d3791d-3d67-4402-8f4b-f6454739d335 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939" status: 404 len: 111 microversion: 2.1 time: 0.055475 Jun 30 13:13:34.736586 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 367/736] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:34 2022] GET /compute/v2.1/servers/9d58b08a-c2ee-4f45-90c0-400b9e677939 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:13:34.745307 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1cec5c4a-1453-4eb3-a91a-c1e4a34b8a16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '.version_select at 0x7f4ba4048940>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:34.776024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1cec5c4a-1453-4eb3-a91a-c1e4a34b8a16 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262057944" status: 202 len: 0 microversion: 2.1 time: 0.034814 Jun 30 13:13:34.777370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 370/737] 10.222.0.49 () {58 vars in 1217 bytes} [Thu Jun 30 13:13:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262057944 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:13:34.907921 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-9fde2ce2-02f4-44cf-8945-6ef4c5d93cd8 req-0117a3a4-bfa8-42bc-a6d0-de7ba0f940c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b755558-bb4a-4894-bb35-0da6a41544ca", "tag": "88658676-64f1-4a38-b5b9-ee5a9a4c65c2"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:34.930960 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-9fde2ce2-02f4-44cf-8945-6ef4c5d93cd8 req-0117a3a4-bfa8-42bc-a6d0-de7ba0f940c9 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:34.932049 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-9fde2ce2-02f4-44cf-8945-6ef4c5d93cd8 req-0117a3a4-bfa8-42bc-a6d0-de7ba0f940c9 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:34.961036 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-9fde2ce2-02f4-44cf-8945-6ef4c5d93cd8 req-0117a3a4-bfa8-42bc-a6d0-de7ba0f940c9 service nova] Creating event network-changed:88658676-64f1-4a38-b5b9-ee5a9a4c65c2 for instance 3b755558-bb4a-4894-bb35-0da6a41544ca on hv-cinder-81268 Jun 30 13:13:34.971268 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-9fde2ce2-02f4-44cf-8945-6ef4c5d93cd8 req-0117a3a4-bfa8-42bc-a6d0-de7ba0f940c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068933 Jun 30 13:13:34.972239 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 368/738] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:13:35.427059 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-28786494-dd86-41cc-af1a-5683cf993083 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:35.427852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-28786494-dd86-41cc-af1a-5683cf993083 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:35.439727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28786494-dd86-41cc-af1a-5683cf993083 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:35.445877 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28786494-dd86-41cc-af1a-5683cf993083 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:35.448057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28786494-dd86-41cc-af1a-5683cf993083 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:35.449256 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-28786494-dd86-41cc-af1a-5683cf993083 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:35.640984 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-28786494-dd86-41cc-af1a-5683cf993083 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:35.648714 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-28786494-dd86-41cc-af1a-5683cf993083 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.225744 Jun 30 13:13:35.649974 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 371/739] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:35 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:35.684490 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-df895cd4-534d-4a85-b70d-c058f229289f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:35.685087 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-df895cd4-534d-4a85-b70d-c058f229289f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:35.692886 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-df895cd4-534d-4a85-b70d-c058f229289f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:35.693679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-df895cd4-534d-4a85-b70d-c058f229289f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:35.694666 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-df895cd4-534d-4a85-b70d-c058f229289f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:35.695155 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-df895cd4-534d-4a85-b70d-c058f229289f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:35.846809 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-df895cd4-534d-4a85-b70d-c058f229289f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:35.854900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-df895cd4-534d-4a85-b70d-c058f229289f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.174394 Jun 30 13:13:35.855333 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 369/740] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:35 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:36.670079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f4a8a96c-75b5-458c-b102-7ed6af0361b7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:36.671105 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f4a8a96c-75b5-458c-b102-7ed6af0361b7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:36.682404 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4a8a96c-75b5-458c-b102-7ed6af0361b7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:36.683430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4a8a96c-75b5-458c-b102-7ed6af0361b7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:36.683905 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4a8a96c-75b5-458c-b102-7ed6af0361b7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:36.684365 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f4a8a96c-75b5-458c-b102-7ed6af0361b7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:36.823465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f4a8a96c-75b5-458c-b102-7ed6af0361b7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:36.831329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f4a8a96c-75b5-458c-b102-7ed6af0361b7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.167699 Jun 30 13:13:36.831899 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 372/741] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:36 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:36.872559 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d20aa0c2-2f68-426e-b258-8f63f9c85ae3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:36.873114 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d20aa0c2-2f68-426e-b258-8f63f9c85ae3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:36.880026 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d20aa0c2-2f68-426e-b258-8f63f9c85ae3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:36.880466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d20aa0c2-2f68-426e-b258-8f63f9c85ae3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:36.881212 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d20aa0c2-2f68-426e-b258-8f63f9c85ae3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:36.881632 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d20aa0c2-2f68-426e-b258-8f63f9c85ae3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:37.017165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d20aa0c2-2f68-426e-b258-8f63f9c85ae3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:37.024952 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d20aa0c2-2f68-426e-b258-8f63f9c85ae3 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.156611 Jun 30 13:13:37.025514 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 370/742] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:36 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:37.855054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-eee8d130-26a4-48b6-83a6-ce28bb940e4c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:37.856055 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-eee8d130-26a4-48b6-83a6-ce28bb940e4c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:37.863333 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eee8d130-26a4-48b6-83a6-ce28bb940e4c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:37.863798 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eee8d130-26a4-48b6-83a6-ce28bb940e4c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:37.864594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eee8d130-26a4-48b6-83a6-ce28bb940e4c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:37.865030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-eee8d130-26a4-48b6-83a6-ce28bb940e4c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:37.998975 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-eee8d130-26a4-48b6-83a6-ce28bb940e4c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:38.010930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-eee8d130-26a4-48b6-83a6-ce28bb940e4c tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.162171 Jun 30 13:13:38.011647 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 373/743] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:37 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:38.042688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fffad369-bf32-4040-81c0-7de5fb56301d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:38.043273 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fffad369-bf32-4040-81c0-7de5fb56301d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:38.050194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fffad369-bf32-4040-81c0-7de5fb56301d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:38.050707 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fffad369-bf32-4040-81c0-7de5fb56301d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:38.051473 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fffad369-bf32-4040-81c0-7de5fb56301d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:38.051898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fffad369-bf32-4040-81c0-7de5fb56301d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:38.078038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ef1cab2d-ab08-4967-b51e-0029a2c14c9d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:38.078553 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ef1cab2d-ab08-4967-b51e-0029a2c14c9d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:38.084841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef1cab2d-ab08-4967-b51e-0029a2c14c9d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:38.085282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef1cab2d-ab08-4967-b51e-0029a2c14c9d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:38.086020 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef1cab2d-ab08-4967-b51e-0029a2c14c9d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:38.086475 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ef1cab2d-ab08-4967-b51e-0029a2c14c9d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:38.112471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ef1cab2d-ab08-4967-b51e-0029a2c14c9d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:13:38.190954 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fffad369-bf32-4040-81c0-7de5fb56301d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:38.193041 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ef1cab2d-ab08-4967-b51e-0029a2c14c9d tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 204 len: 0 microversion: 2.1 time: 0.118335 Jun 30 13:13:38.193644 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 374/744] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:13:38 2022] DELETE /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:13:38.200372 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fffad369-bf32-4040-81c0-7de5fb56301d tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.161472 Jun 30 13:13:38.201665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-06b2c0c7-c93b-47ba-8010-c2c98709cab8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:38.202111 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 371/745] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:38 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:38.202617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-06b2c0c7-c93b-47ba-8010-c2c98709cab8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:38.208804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b2c0c7-c93b-47ba-8010-c2c98709cab8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:38.209237 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b2c0c7-c93b-47ba-8010-c2c98709cab8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:38.209989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b2c0c7-c93b-47ba-8010-c2c98709cab8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:38.210422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-06b2c0c7-c93b-47ba-8010-c2c98709cab8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:38.391988 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-06b2c0c7-c93b-47ba-8010-c2c98709cab8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:38.403511 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-06b2c0c7-c93b-47ba-8010-c2c98709cab8 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1509 microversion: 2.1 time: 0.205846 Jun 30 13:13:38.404079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 375/746] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:38 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:13:39.029660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-246824b4-070f-4ae3-a2d4-6bbfd0c1df3d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:39.030258 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-246824b4-070f-4ae3-a2d4-6bbfd0c1df3d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:39.036732 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-246824b4-070f-4ae3-a2d4-6bbfd0c1df3d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:39.037137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-246824b4-070f-4ae3-a2d4-6bbfd0c1df3d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:39.038088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-246824b4-070f-4ae3-a2d4-6bbfd0c1df3d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:39.038731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-246824b4-070f-4ae3-a2d4-6bbfd0c1df3d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:39.223351 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bd728ad0-bc2c-45d7-8e44-4a07fbe59714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:39.224065 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bd728ad0-bc2c-45d7-8e44-4a07fbe59714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:39.245414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-246824b4-070f-4ae3-a2d4-6bbfd0c1df3d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:39.252452 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd728ad0-bc2c-45d7-8e44-4a07fbe59714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:39.253754 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd728ad0-bc2c-45d7-8e44-4a07fbe59714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:39.254898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-246824b4-070f-4ae3-a2d4-6bbfd0c1df3d tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.229354 Jun 30 13:13:39.256911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 372/747] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:39 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:39.259778 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd728ad0-bc2c-45d7-8e44-4a07fbe59714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:39.260926 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bd728ad0-bc2c-45d7-8e44-4a07fbe59714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:39.421316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c7d63315-a2cb-4c14-aee3-e0e88f0fbe2b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:39.421899 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c7d63315-a2cb-4c14-aee3-e0e88f0fbe2b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:39.428295 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7d63315-a2cb-4c14-aee3-e0e88f0fbe2b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:39.428729 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7d63315-a2cb-4c14-aee3-e0e88f0fbe2b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:39.429493 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7d63315-a2cb-4c14-aee3-e0e88f0fbe2b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:39.429915 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7d63315-a2cb-4c14-aee3-e0e88f0fbe2b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:39.479657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bd728ad0-bc2c-45d7-8e44-4a07fbe59714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:39.487620 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bd728ad0-bc2c-45d7-8e44-4a07fbe59714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.270068 Jun 30 13:13:39.488654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 376/748] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:39 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:39.566916 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c7d63315-a2cb-4c14-aee3-e0e88f0fbe2b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:39.574739 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c7d63315-a2cb-4c14-aee3-e0e88f0fbe2b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1509 microversion: 2.1 time: 0.157570 Jun 30 13:13:39.575310 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 373/749] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:39 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:39.647524 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-ac4cc363-d1d6-4296-80a0-cd822d5fb72a req-d528021f-715f-40d9-a895-96975885d435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711b43e6-7228-4df7-83dc-7c52bc321cee", "name": "network-vif-deleted", "tag": "610276b3-7f63-41a6-a116-42955224eed0"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:39.656619 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ac4cc363-d1d6-4296-80a0-cd822d5fb72a req-d528021f-715f-40d9-a895-96975885d435 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:39.657063 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ac4cc363-d1d6-4296-80a0-cd822d5fb72a req-d528021f-715f-40d9-a895-96975885d435 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:39.668880 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-ac4cc363-d1d6-4296-80a0-cd822d5fb72a req-d528021f-715f-40d9-a895-96975885d435 service nova] Creating event network-vif-deleted:610276b3-7f63-41a6-a116-42955224eed0 for instance 711b43e6-7228-4df7-83dc-7c52bc321cee on hv-cinder-81268 Jun 30 13:13:39.673949 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-ac4cc363-d1d6-4296-80a0-cd822d5fb72a req-d528021f-715f-40d9-a895-96975885d435 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 Jun 30 13:13:39.674599 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 377/750] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:40.273530 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-881ac8fc-1c10-4ae6-b028-d8fdc203ad06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:40.274160 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-881ac8fc-1c10-4ae6-b028-d8fdc203ad06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:40.281585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-881ac8fc-1c10-4ae6-b028-d8fdc203ad06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:40.282047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-881ac8fc-1c10-4ae6-b028-d8fdc203ad06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:40.282869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-881ac8fc-1c10-4ae6-b028-d8fdc203ad06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:40.283313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-881ac8fc-1c10-4ae6-b028-d8fdc203ad06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:40.421485 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-881ac8fc-1c10-4ae6-b028-d8fdc203ad06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:40.433558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-881ac8fc-1c10-4ae6-b028-d8fdc203ad06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.163429 Jun 30 13:13:40.434131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 374/751] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:40 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:40.505756 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-148704d2-9b46-401a-81c7-74990ae0e4d0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:40.507063 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-148704d2-9b46-401a-81c7-74990ae0e4d0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:40.515850 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-148704d2-9b46-401a-81c7-74990ae0e4d0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:40.516282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-148704d2-9b46-401a-81c7-74990ae0e4d0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:40.517237 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-148704d2-9b46-401a-81c7-74990ae0e4d0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:40.517650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-148704d2-9b46-401a-81c7-74990ae0e4d0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:40.592317 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b04c94ad-21de-4c0d-99f6-4a5efc3ba34a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:40.592921 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b04c94ad-21de-4c0d-99f6-4a5efc3ba34a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:40.599946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b04c94ad-21de-4c0d-99f6-4a5efc3ba34a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:40.599946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b04c94ad-21de-4c0d-99f6-4a5efc3ba34a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:40.600673 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b04c94ad-21de-4c0d-99f6-4a5efc3ba34a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:40.601134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b04c94ad-21de-4c0d-99f6-4a5efc3ba34a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:40.654861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-148704d2-9b46-401a-81c7-74990ae0e4d0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:40.662669 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-148704d2-9b46-401a-81c7-74990ae0e4d0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.161189 Jun 30 13:13:40.663071 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b04c94ad-21de-4c0d-99f6-4a5efc3ba34a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:40.663233 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 378/752] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:40 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:13:40.670991 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b04c94ad-21de-4c0d-99f6-4a5efc3ba34a tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 200 len: 1293 microversion: 2.1 time: 0.082742 Jun 30 13:13:40.671544 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 375/753] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:40 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:41.313373 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-eb0a1daa-fc04-40b6-8ccb-8ab67e22cc19 req-eba566ce-ab98-4cc9-a63f-6c122511a163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b755558-bb4a-4894-bb35-0da6a41544ca", "name": "network-vif-plugged", "status": "completed", "tag": "88658676-64f1-4a38-b5b9-ee5a9a4c65c2"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:41.322671 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-eb0a1daa-fc04-40b6-8ccb-8ab67e22cc19 req-eba566ce-ab98-4cc9-a63f-6c122511a163 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.323107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-eb0a1daa-fc04-40b6-8ccb-8ab67e22cc19 req-eba566ce-ab98-4cc9-a63f-6c122511a163 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.335500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-eb0a1daa-fc04-40b6-8ccb-8ab67e22cc19 req-eba566ce-ab98-4cc9-a63f-6c122511a163 service nova] Creating event network-vif-plugged:88658676-64f1-4a38-b5b9-ee5a9a4c65c2 for instance 3b755558-bb4a-4894-bb35-0da6a41544ca on hv-cinder-81268 Jun 30 13:13:41.340942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-eb0a1daa-fc04-40b6-8ccb-8ab67e22cc19 req-eba566ce-ab98-4cc9-a63f-6c122511a163 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031286 Jun 30 13:13:41.341823 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 379/754] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:41.450242 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b2c7092d-a353-4ae5-8dbf-642ae808e479 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:41.451549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b2c7092d-a353-4ae5-8dbf-642ae808e479 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:41.453547 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:41.454221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=12 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:41.460551 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b2c7092d-a353-4ae5-8dbf-642ae808e479 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.460972 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b2c7092d-a353-4ae5-8dbf-642ae808e479 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.461719 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b2c7092d-a353-4ae5-8dbf-642ae808e479 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.462202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b2c7092d-a353-4ae5-8dbf-642ae808e479 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.602288 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b2c7092d-a353-4ae5-8dbf-642ae808e479 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:41.611605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b2c7092d-a353-4ae5-8dbf-642ae808e479 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.165136 Jun 30 13:13:41.612196 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 376/755] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:41 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:41.686421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e2a1a32f-5b2e-4ab7-9d79-9a730145f45e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:41.688680 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e2a1a32f-5b2e-4ab7-9d79-9a730145f45e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:41.691497 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:41.692482 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 711b43e6-7228-4df7-83dc-7c52bc321cee] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:41.699633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2a1a32f-5b2e-4ab7-9d79-9a730145f45e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.700083 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2a1a32f-5b2e-4ab7-9d79-9a730145f45e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.700813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.700935 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2a1a32f-5b2e-4ab7-9d79-9a730145f45e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.701245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.701383 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e2a1a32f-5b2e-4ab7-9d79-9a730145f45e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.701990 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.702438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.717328 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] HTTP exception thrown: Instance 711b43e6-7228-4df7-83dc-7c52bc321cee could not be found. Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Request method failure captured: Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee HTTP/1.1 Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivaAIiDqmzBk003FXqe908sKplnTOTTe0uls5Nb8W8-zMdKmCsB-qpzXIvF9yYVYkb9yALsgVIgttIi01Upr8CXOW-00eiFTlAUMZr93waJwCoH1jb-eeAiJZG7ktMvlqrdytI7P28ZHMQbEezLOmyoqkbkEskw-g3MbLo0VWlZFO-ZE Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:13:41.719361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_792f217e834c4049b5b0d856cd53f947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}] Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: a7ce962e4a7447848e3454905102d27c Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 711b43e6-7228-4df7-83dc-7c52bc321cee could not be found. Jun 30 13:13:41.720863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '711b43e6-7228-4df7-83dc-7c52bc321cee'} Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711b43e6-7228-4df7-83dc-7c52bc321cee could not be found. Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:13:41.721761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711b43e6-7228-4df7-83dc-7c52bc321cee could not be found. Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711b43e6-7228-4df7-83dc-7c52bc321cee could not be found. Jun 30 13:13:41.723865 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:13:41.725414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Returning 404 to user: Instance 711b43e6-7228-4df7-83dc-7c52bc321cee could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:13:41.725414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-626360cc-7730-4e35-9532-5f746bcf9114 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee" status: 404 len: 111 microversion: 2.1 time: 0.035635 Jun 30 13:13:41.725414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 377/756] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:41 2022] GET /compute/v2.1/servers/711b43e6-7228-4df7-83dc-7c52bc321cee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:13:41.728911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b4cd649c-7361-4afd-ad91-f9dd6055ce4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:41.729388 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b4cd649c-7361-4afd-ad91-f9dd6055ce4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:41.735810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4cd649c-7361-4afd-ad91-f9dd6055ce4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.736365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4cd649c-7361-4afd-ad91-f9dd6055ce4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.737165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4cd649c-7361-4afd-ad91-f9dd6055ce4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.737760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b4cd649c-7361-4afd-ad91-f9dd6055ce4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.763814 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b4cd649c-7361-4afd-ad91-f9dd6055ce4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:13:41.829554 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:41.840547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e2a1a32f-5b2e-4ab7-9d79-9a730145f45e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:41.847491 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b4cd649c-7361-4afd-ad91-f9dd6055ce4b tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 204 len: 0 microversion: 2.1 time: 0.121855 Jun 30 13:13:41.848293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 378/757] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:13:41 2022] DELETE /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:13:41.849295 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e2a1a32f-5b2e-4ab7-9d79-9a730145f45e tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1568 microversion: 2.1 time: 0.171916 Jun 30 13:13:41.849887 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 380/758] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:41 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:41.856695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1d6e229f-6733-41b9-be8a-9652e5c227b6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:41.857385 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1d6e229f-6733-41b9-be8a-9652e5c227b6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:41.863629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1d6e229f-6733-41b9-be8a-9652e5c227b6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.864090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1d6e229f-6733-41b9-be8a-9652e5c227b6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.864879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1d6e229f-6733-41b9-be8a-9652e5c227b6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.865324 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1d6e229f-6733-41b9-be8a-9652e5c227b6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.865769 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c9af406-f100-49e2-94f9-5ffa8b7650f1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:41.866347 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c9af406-f100-49e2-94f9-5ffa8b7650f1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:41.872731 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c9af406-f100-49e2-94f9-5ffa8b7650f1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.873167 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c9af406-f100-49e2-94f9-5ffa8b7650f1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.873911 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c9af406-f100-49e2-94f9-5ffa8b7650f1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.874347 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c9af406-f100-49e2-94f9-5ffa8b7650f1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.952125 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c9af406-f100-49e2-94f9-5ffa8b7650f1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "POST /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4/action" status: 202 len: 0 microversion: 2.1 time: 0.090271 Jun 30 13:13:41.952741 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 381/759] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:13:41 2022] POST /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 13:13:41.960822 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1521d65b-5655-4167-b22c-87bb8240b810 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:41.961432 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1521d65b-5655-4167-b22c-87bb8240b810 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:41.968016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1521d65b-5655-4167-b22c-87bb8240b810 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.968798 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1521d65b-5655-4167-b22c-87bb8240b810 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:41.969576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1521d65b-5655-4167-b22c-87bb8240b810 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:41.970008 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1521d65b-5655-4167-b22c-87bb8240b810 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:42.008771 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1d6e229f-6733-41b9-be8a-9652e5c227b6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:42.017565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1d6e229f-6733-41b9-be8a-9652e5c227b6 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.164912 Jun 30 13:13:42.018143 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 379/760] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:41 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:42.112158 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1521d65b-5655-4167-b22c-87bb8240b810 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:42.119747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1521d65b-5655-4167-b22c-87bb8240b810 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1576 microversion: 2.1 time: 0.162683 Jun 30 13:13:42.120638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 382/761] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:41 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:13:42.629155 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0982ef7a-dac4-438c-90c5-0d41d0b3d6c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:42.629762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0982ef7a-dac4-438c-90c5-0d41d0b3d6c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:42.637304 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0982ef7a-dac4-438c-90c5-0d41d0b3d6c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:42.637745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0982ef7a-dac4-438c-90c5-0d41d0b3d6c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:42.638536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0982ef7a-dac4-438c-90c5-0d41d0b3d6c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:42.638964 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0982ef7a-dac4-438c-90c5-0d41d0b3d6c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:42.771252 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0982ef7a-dac4-438c-90c5-0d41d0b3d6c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:42.779638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0982ef7a-dac4-438c-90c5-0d41d0b3d6c9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.154484 Jun 30 13:13:42.780267 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 380/762] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:42 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:43.037890 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5271ad6c-263e-4a7e-9c11-91d754c9b643 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:43.038677 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5271ad6c-263e-4a7e-9c11-91d754c9b643 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:43.047946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5271ad6c-263e-4a7e-9c11-91d754c9b643 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:43.048705 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5271ad6c-263e-4a7e-9c11-91d754c9b643 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:43.049758 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5271ad6c-263e-4a7e-9c11-91d754c9b643 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:43.050386 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5271ad6c-263e-4a7e-9c11-91d754c9b643 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:43.137658 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-43a740f4-91c7-4f88-ab52-015c02d68d14 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:43.138253 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-43a740f4-91c7-4f88-ab52-015c02d68d14 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:43.144468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43a740f4-91c7-4f88-ab52-015c02d68d14 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:43.144900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43a740f4-91c7-4f88-ab52-015c02d68d14 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:43.145646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43a740f4-91c7-4f88-ab52-015c02d68d14 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:43.146062 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43a740f4-91c7-4f88-ab52-015c02d68d14 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:43.193525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5271ad6c-263e-4a7e-9c11-91d754c9b643 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:43.201456 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5271ad6c-263e-4a7e-9c11-91d754c9b643 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.169365 Jun 30 13:13:43.202027 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 383/763] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:43 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:43.278979 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-43a740f4-91c7-4f88-ab52-015c02d68d14 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:43.286957 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-43a740f4-91c7-4f88-ab52-015c02d68d14 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1516 microversion: 2.1 time: 0.153444 Jun 30 13:13:43.287494 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 381/764] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:43 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:13:43.801965 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6697203e-cfe0-4edd-859b-90943aabf5fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:43.803001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6697203e-cfe0-4edd-859b-90943aabf5fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:43.813556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6697203e-cfe0-4edd-859b-90943aabf5fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:43.814290 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6697203e-cfe0-4edd-859b-90943aabf5fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:43.815586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6697203e-cfe0-4edd-859b-90943aabf5fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:43.816297 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6697203e-cfe0-4edd-859b-90943aabf5fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:43.951539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6697203e-cfe0-4edd-859b-90943aabf5fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:43.959198 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6697203e-cfe0-4edd-859b-90943aabf5fa tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1362 microversion: 2.1 time: 0.163828 Jun 30 13:13:43.959763 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 384/765] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:43 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:44.219502 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c239891b-ddee-41ca-b80f-fa5a4476d759 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:44.220085 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c239891b-ddee-41ca-b80f-fa5a4476d759 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:44.227089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c239891b-ddee-41ca-b80f-fa5a4476d759 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:44.227544 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c239891b-ddee-41ca-b80f-fa5a4476d759 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:44.228290 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c239891b-ddee-41ca-b80f-fa5a4476d759 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:44.228711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c239891b-ddee-41ca-b80f-fa5a4476d759 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:44.304815 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db6010c1-0c3c-43bc-bb05-9cf830384b6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:44.305469 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db6010c1-0c3c-43bc-bb05-9cf830384b6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:44.312531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db6010c1-0c3c-43bc-bb05-9cf830384b6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:44.312894 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db6010c1-0c3c-43bc-bb05-9cf830384b6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:44.313612 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db6010c1-0c3c-43bc-bb05-9cf830384b6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:44.314061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db6010c1-0c3c-43bc-bb05-9cf830384b6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:44.361260 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c239891b-ddee-41ca-b80f-fa5a4476d759 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:44.364774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:44.369475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c239891b-ddee-41ca-b80f-fa5a4476d759 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.154325 Jun 30 13:13:44.370048 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 382/766] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:44 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:44.449495 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db6010c1-0c3c-43bc-bb05-9cf830384b6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:44.461285 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db6010c1-0c3c-43bc-bb05-9cf830384b6b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1518 microversion: 2.1 time: 0.160136 Jun 30 13:13:44.462052 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 385/767] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:44 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:44.983810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c8baff83-77e1-4606-b15f-1e058c4e8fa7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:44.984811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c8baff83-77e1-4606-b15f-1e058c4e8fa7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:44.995664 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c8baff83-77e1-4606-b15f-1e058c4e8fa7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:44.996093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c8baff83-77e1-4606-b15f-1e058c4e8fa7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:44.996855 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c8baff83-77e1-4606-b15f-1e058c4e8fa7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:44.997278 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c8baff83-77e1-4606-b15f-1e058c4e8fa7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:45.139080 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c8baff83-77e1-4606-b15f-1e058c4e8fa7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:45.148875 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c8baff83-77e1-4606-b15f-1e058c4e8fa7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1547 microversion: 2.1 time: 0.174390 Jun 30 13:13:45.150101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 383/768] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:44 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:45.168013 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-44561c90-7d69-4f45-b2ae-42cc9702baa5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:45.168775 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-44561c90-7d69-4f45-b2ae-42cc9702baa5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:45.176594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44561c90-7d69-4f45-b2ae-42cc9702baa5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:45.177403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44561c90-7d69-4f45-b2ae-42cc9702baa5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:45.178389 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44561c90-7d69-4f45-b2ae-42cc9702baa5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:45.178966 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44561c90-7d69-4f45-b2ae-42cc9702baa5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:45.186571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:45.221020 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-770a7960-4d74-4718-830b-f4e9029dda8a req-69c4aa41-d31e-4cb3-b614-d0cdc4362d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6237f937-32a4-40da-aebc-6bc1311b08a4", "name": "network-vif-unplugged", "status": "completed", "tag": "da28b1a6-cb2b-4c40-9af4-d3051711bd7c"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:45.232034 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-770a7960-4d74-4718-830b-f4e9029dda8a req-69c4aa41-d31e-4cb3-b614-d0cdc4362d10 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:45.232598 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-770a7960-4d74-4718-830b-f4e9029dda8a req-69c4aa41-d31e-4cb3-b614-d0cdc4362d10 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:45.246576 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.compute.server_external_events [req-770a7960-4d74-4718-830b-f4e9029dda8a req-69c4aa41-d31e-4cb3-b614-d0cdc4362d10 service nova] Unable to find a host for instance 6237f937-32a4-40da-aebc-6bc1311b08a4. Dropping event network-vif-unplugged {{(pid=117826) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 13:13:45.247852 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-770a7960-4d74-4718-830b-f4e9029dda8a req-69c4aa41-d31e-4cb3-b614-d0cdc4362d10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033976 Jun 30 13:13:45.248477 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 384/769] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 30 13:13:45.388652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-94f84afc-db70-48cb-887f-a08a12973881 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:45.389331 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-94f84afc-db70-48cb-887f-a08a12973881 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:45.396150 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-94f84afc-db70-48cb-887f-a08a12973881 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:45.396507 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-94f84afc-db70-48cb-887f-a08a12973881 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:45.397286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-94f84afc-db70-48cb-887f-a08a12973881 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:45.397722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-94f84afc-db70-48cb-887f-a08a12973881 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:45.479487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-44561c90-7d69-4f45-b2ae-42cc9702baa5 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.316950 Jun 30 13:13:45.480339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 386/770] 10.222.0.49 () {58 vars in 1274 bytes} [Thu Jun 30 13:13:45 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:13:45.486576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e327f3d-8c89-4744-80df-840ceb83b682 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:45.487183 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1e327f3d-8c89-4744-80df-840ceb83b682 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:45.493593 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e327f3d-8c89-4744-80df-840ceb83b682 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:45.494145 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e327f3d-8c89-4744-80df-840ceb83b682 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:45.495011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e327f3d-8c89-4744-80df-840ceb83b682 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:45.495821 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e327f3d-8c89-4744-80df-840ceb83b682 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:45.547515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-94f84afc-db70-48cb-887f-a08a12973881 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:45.555931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-94f84afc-db70-48cb-887f-a08a12973881 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1521 microversion: 2.1 time: 0.172167 Jun 30 13:13:45.556492 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 385/771] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:45 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:45.892088 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1e327f3d-8c89-4744-80df-840ceb83b682 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:45.900480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1e327f3d-8c89-4744-80df-840ceb83b682 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1518 microversion: 2.1 time: 0.418988 Jun 30 13:13:45.901228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 387/772] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:45 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:46.252024 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-1d6e9e6a-ec61-46c1-a18d-8cc9f624ea31 req-d22a9e73-801d-40d6-ad7a-880718a84c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227d6c05-e0fc-477e-a03e-cf5160212c76", "name": "network-vif-deleted", "tag": "569d371d-6431-4ca3-b618-9b53f8f12f0f"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:46.266907 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-1d6e9e6a-ec61-46c1-a18d-8cc9f624ea31 req-d22a9e73-801d-40d6-ad7a-880718a84c15 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:46.270257 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-1d6e9e6a-ec61-46c1-a18d-8cc9f624ea31 req-d22a9e73-801d-40d6-ad7a-880718a84c15 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:46.300678 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-1d6e9e6a-ec61-46c1-a18d-8cc9f624ea31 req-d22a9e73-801d-40d6-ad7a-880718a84c15 service nova] Creating event network-vif-deleted:569d371d-6431-4ca3-b618-9b53f8f12f0f for instance 227d6c05-e0fc-477e-a03e-cf5160212c76 on hv-cinder-81268 Jun 30 13:13:46.306817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-1d6e9e6a-ec61-46c1-a18d-8cc9f624ea31 req-d22a9e73-801d-40d6-ad7a-880718a84c15 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058404 Jun 30 13:13:46.307835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 386/773] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:13:46.573969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:46.574581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:46.581158 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:46.581864 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:46.582650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:46.583069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:46.616345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:46.616789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:46.617228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lazy-loading 'fault' on Instance uuid 227d6c05-e0fc-477e-a03e-cf5160212c76 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:13:46.688509 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ce962e4a7447848e3454905102d27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f217e834c4049b5b0d856cd53f947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:46.696484 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-08b4abfd-a5ff-42d8-b470-e000f3ae5c41 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 200 len: 1311 microversion: 2.1 time: 0.126516 Jun 30 13:13:46.699598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 388/774] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:46 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:47.029640 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1e7e02f9-06e4-4daa-a8a0-052bdfe90eac tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:47.030353 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1e7e02f9-06e4-4daa-a8a0-052bdfe90eac tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:47.037165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1e7e02f9-06e4-4daa-a8a0-052bdfe90eac tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:47.037795 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1e7e02f9-06e4-4daa-a8a0-052bdfe90eac tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:47.038753 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1e7e02f9-06e4-4daa-a8a0-052bdfe90eac tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:47.039458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1e7e02f9-06e4-4daa-a8a0-052bdfe90eac tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:47.184685 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1e7e02f9-06e4-4daa-a8a0-052bdfe90eac tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:47.193691 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1e7e02f9-06e4-4daa-a8a0-052bdfe90eac tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.277717 Jun 30 13:13:47.194132 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 387/775] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:46 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:47.715817 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:47.716539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] [instance: 227d6c05-e0fc-477e-a03e-cf5160212c76] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:47.724244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:47.724508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:47.725277 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:47.725692 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:47.740081 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] HTTP exception thrown: Instance 227d6c05-e0fc-477e-a03e-cf5160212c76 could not be found. Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Request method failure captured: Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 HTTP/1.1 Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaAIiDqmzBk003FXqe908sKplnTOTTe0uls5Nb8W8-zMdKmCsB-qpzXIvF9yYVYkb9yALsgVIgttIi01Upr8CXOW-00eiFTlAUMZr93waJwCoH1jb-eeAiJZG7ktMvlqrdytI7P28ZHMQbEezLOmyoqkbkEskw-g3MbLo0VWlZFO-ZE Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:13:47.741745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_792f217e834c4049b5b0d856cd53f947"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/792f217e834c4049b5b0d856cd53f947"}]}] Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 792f217e834c4049b5b0d856cd53f947 Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-487729153 Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: a7ce962e4a7447848e3454905102d27c Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-ServerRescueNegativeTestJSON-487729153-project Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 227d6c05-e0fc-477e-a03e-cf5160212c76 could not be found. Jun 30 13:13:47.743283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '227d6c05-e0fc-477e-a03e-cf5160212c76'} Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227d6c05-e0fc-477e-a03e-cf5160212c76 could not be found. Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:13:47.744163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227d6c05-e0fc-477e-a03e-cf5160212c76 could not be found. Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227d6c05-e0fc-477e-a03e-cf5160212c76 could not be found. Jun 30 13:13:47.746228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:13:47.748452 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] Returning 404 to user: Instance 227d6c05-e0fc-477e-a03e-cf5160212c76 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:13:47.748452 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-470413cb-44ac-484c-9e34-9cd51453a3b9 tempest-ServerRescueNegativeTestJSON-487729153 tempest-ServerRescueNegativeTestJSON-487729153-project] 10.222.0.49 "GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76" status: 404 len: 111 microversion: 2.1 time: 0.031646 Jun 30 13:13:47.748452 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 389/776] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:47 2022] GET /compute/v2.1/servers/227d6c05-e0fc-477e-a03e-cf5160212c76 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:13:48.212135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-efe1321d-b4ca-4c5e-bd80-7d07be4b4317 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:48.212740 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-efe1321d-b4ca-4c5e-bd80-7d07be4b4317 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:48.221508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-efe1321d-b4ca-4c5e-bd80-7d07be4b4317 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:48.221924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-efe1321d-b4ca-4c5e-bd80-7d07be4b4317 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:48.222749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-efe1321d-b4ca-4c5e-bd80-7d07be4b4317 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:48.223175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-efe1321d-b4ca-4c5e-bd80-7d07be4b4317 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:48.324390 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-a8b6a9f8-988a-447c-ac5a-6a6939a4ce9c req-077afb05-a27d-45b7-bc0e-b84f02ddff9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b755558-bb4a-4894-bb35-0da6a41544ca", "tag": "88658676-64f1-4a38-b5b9-ee5a9a4c65c2"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:48.332657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a8b6a9f8-988a-447c-ac5a-6a6939a4ce9c req-077afb05-a27d-45b7-bc0e-b84f02ddff9d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:48.333111 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a8b6a9f8-988a-447c-ac5a-6a6939a4ce9c req-077afb05-a27d-45b7-bc0e-b84f02ddff9d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:48.344802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-a8b6a9f8-988a-447c-ac5a-6a6939a4ce9c req-077afb05-a27d-45b7-bc0e-b84f02ddff9d service nova] Creating event network-changed:88658676-64f1-4a38-b5b9-ee5a9a4c65c2 for instance 3b755558-bb4a-4894-bb35-0da6a41544ca on hv-cinder-81268 Jun 30 13:13:48.350017 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-a8b6a9f8-988a-447c-ac5a-6a6939a4ce9c req-077afb05-a27d-45b7-bc0e-b84f02ddff9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029381 Jun 30 13:13:48.350936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 390/777] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:13:48.428866 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-efe1321d-b4ca-4c5e-bd80-7d07be4b4317 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:48.437453 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-efe1321d-b4ca-4c5e-bd80-7d07be4b4317 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.230403 Jun 30 13:13:48.438129 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 388/778] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:48 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:49.455906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-56996ea5-5c7a-415b-8818-4678e34d79a0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:49.456598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-56996ea5-5c7a-415b-8818-4678e34d79a0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:49.463032 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56996ea5-5c7a-415b-8818-4678e34d79a0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:49.463475 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56996ea5-5c7a-415b-8818-4678e34d79a0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:49.464363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56996ea5-5c7a-415b-8818-4678e34d79a0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:49.464791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-56996ea5-5c7a-415b-8818-4678e34d79a0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:49.607496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-56996ea5-5c7a-415b-8818-4678e34d79a0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:49.615571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-56996ea5-5c7a-415b-8818-4678e34d79a0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.164590 Jun 30 13:13:49.616469 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 391/779] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:49 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:50.633797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c358a82d-d9a3-4ea6-b2a3-568f366084c1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:50.634574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c358a82d-d9a3-4ea6-b2a3-568f366084c1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:50.642034 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c358a82d-d9a3-4ea6-b2a3-568f366084c1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:50.642510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c358a82d-d9a3-4ea6-b2a3-568f366084c1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:50.643268 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c358a82d-d9a3-4ea6-b2a3-568f366084c1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:50.643744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c358a82d-d9a3-4ea6-b2a3-568f366084c1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:50.861352 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c358a82d-d9a3-4ea6-b2a3-568f366084c1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:50.871364 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c358a82d-d9a3-4ea6-b2a3-568f366084c1 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.241894 Jun 30 13:13:50.880978 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 389/780] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:50 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:51.888121 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5fc42d32-6e10-4065-87c2-f2143b9cdc98 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:51.888724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5fc42d32-6e10-4065-87c2-f2143b9cdc98 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:51.895420 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc42d32-6e10-4065-87c2-f2143b9cdc98 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:51.895848 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc42d32-6e10-4065-87c2-f2143b9cdc98 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:51.896576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc42d32-6e10-4065-87c2-f2143b9cdc98 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:51.897038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5fc42d32-6e10-4065-87c2-f2143b9cdc98 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:52.031704 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5fc42d32-6e10-4065-87c2-f2143b9cdc98 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:52.039283 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5fc42d32-6e10-4065-87c2-f2143b9cdc98 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.155442 Jun 30 13:13:52.039853 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 392/781] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:51 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:53.056582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-086a4d68-1c9a-4666-aa39-7d924cce048b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:53.057289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-086a4d68-1c9a-4666-aa39-7d924cce048b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:53.064381 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-086a4d68-1c9a-4666-aa39-7d924cce048b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:53.064927 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-086a4d68-1c9a-4666-aa39-7d924cce048b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:53.065758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-086a4d68-1c9a-4666-aa39-7d924cce048b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:53.066250 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-086a4d68-1c9a-4666-aa39-7d924cce048b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:53.293583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-086a4d68-1c9a-4666-aa39-7d924cce048b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:53.301396 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-086a4d68-1c9a-4666-aa39-7d924cce048b tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.248901 Jun 30 13:13:53.301966 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 390/782] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:53 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:54.319097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-322c89ba-f82f-4ba8-a259-578a85d8eccf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:54.319729 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-322c89ba-f82f-4ba8-a259-578a85d8eccf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:54.326302 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-322c89ba-f82f-4ba8-a259-578a85d8eccf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:54.326877 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-322c89ba-f82f-4ba8-a259-578a85d8eccf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:54.327709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-322c89ba-f82f-4ba8-a259-578a85d8eccf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:54.328224 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-322c89ba-f82f-4ba8-a259-578a85d8eccf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:54.469038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-322c89ba-f82f-4ba8-a259-578a85d8eccf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:54.476781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-322c89ba-f82f-4ba8-a259-578a85d8eccf tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.161636 Jun 30 13:13:54.477354 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 393/783] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:54 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:55.494692 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a5c3d25a-070a-4ca9-9f4b-8c0db8b1a302 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:55.495589 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a5c3d25a-070a-4ca9-9f4b-8c0db8b1a302 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:55.503072 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a5c3d25a-070a-4ca9-9f4b-8c0db8b1a302 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:55.503650 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a5c3d25a-070a-4ca9-9f4b-8c0db8b1a302 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:55.504484 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a5c3d25a-070a-4ca9-9f4b-8c0db8b1a302 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:55.504995 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a5c3d25a-070a-4ca9-9f4b-8c0db8b1a302 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:55.656259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a5c3d25a-070a-4ca9-9f4b-8c0db8b1a302 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:55.671207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a5c3d25a-070a-4ca9-9f4b-8c0db8b1a302 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.180701 Jun 30 13:13:55.671880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 391/784] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:55 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:56.688961 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9f4e5efa-bee0-446d-a2c1-60ef814bd990 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:56.689511 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9f4e5efa-bee0-446d-a2c1-60ef814bd990 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:56.691971 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:13:56.698334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f4e5efa-bee0-446d-a2c1-60ef814bd990 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:56.698939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f4e5efa-bee0-446d-a2c1-60ef814bd990 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:56.699769 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f4e5efa-bee0-446d-a2c1-60ef814bd990 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:56.700203 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9f4e5efa-bee0-446d-a2c1-60ef814bd990 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:56.836177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9f4e5efa-bee0-446d-a2c1-60ef814bd990 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:56.844090 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9f4e5efa-bee0-446d-a2c1-60ef814bd990 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.158868 Jun 30 13:13:56.844686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 394/785] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:56 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:57.861163 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-333c8042-4591-4346-b38e-4156c230e714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:57.861778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-333c8042-4591-4346-b38e-4156c230e714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:57.868175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-333c8042-4591-4346-b38e-4156c230e714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:57.868624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-333c8042-4591-4346-b38e-4156c230e714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:57.869354 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-333c8042-4591-4346-b38e-4156c230e714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:57.869790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-333c8042-4591-4346-b38e-4156c230e714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:58.012037 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-333c8042-4591-4346-b38e-4156c230e714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:58.024173 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-333c8042-4591-4346-b38e-4156c230e714 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.166661 Jun 30 13:13:58.025206 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 392/786] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:57 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:59.044292 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d1cb27cf-a156-46de-aac7-eed17eb75899 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:13:59.045012 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d1cb27cf-a156-46de-aac7-eed17eb75899 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:13:59.051570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cb27cf-a156-46de-aac7-eed17eb75899 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:59.052020 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cb27cf-a156-46de-aac7-eed17eb75899 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:59.052764 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cb27cf-a156-46de-aac7-eed17eb75899 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:59.053187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d1cb27cf-a156-46de-aac7-eed17eb75899 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:59.196640 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d1cb27cf-a156-46de-aac7-eed17eb75899 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:13:59.205195 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d1cb27cf-a156-46de-aac7-eed17eb75899 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.165732 Jun 30 13:13:59.206022 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 395/787] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:13:59 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:13:59.339712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-3ba9a28c-7775-45f2-8694-7c5fae29d67b req-3b4adb47-4b9f-4e44-852d-ea7aa2425086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6237f937-32a4-40da-aebc-6bc1311b08a4", "name": "network-vif-plugged", "status": "completed", "tag": "da28b1a6-cb2b-4c40-9af4-d3051711bd7c"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:13:59.349336 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3ba9a28c-7775-45f2-8694-7c5fae29d67b req-3b4adb47-4b9f-4e44-852d-ea7aa2425086 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:13:59.349920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3ba9a28c-7775-45f2-8694-7c5fae29d67b req-3b4adb47-4b9f-4e44-852d-ea7aa2425086 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:13:59.364146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-3ba9a28c-7775-45f2-8694-7c5fae29d67b req-3b4adb47-4b9f-4e44-852d-ea7aa2425086 service nova] Creating event network-vif-plugged:da28b1a6-cb2b-4c40-9af4-d3051711bd7c for instance 6237f937-32a4-40da-aebc-6bc1311b08a4 on hv-cinder-81268 Jun 30 13:13:59.378958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-3ba9a28c-7775-45f2-8694-7c5fae29d67b req-3b4adb47-4b9f-4e44-852d-ea7aa2425086 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033622 Jun 30 13:13:59.379726 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 393/788] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:00.227332 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-68be2962-b62f-443e-bdae-a32405132875 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:00.228339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-68be2962-b62f-443e-bdae-a32405132875 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:00.239703 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68be2962-b62f-443e-bdae-a32405132875 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:00.240439 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68be2962-b62f-443e-bdae-a32405132875 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:00.241721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68be2962-b62f-443e-bdae-a32405132875 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:00.242425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-68be2962-b62f-443e-bdae-a32405132875 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:00.390363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-68be2962-b62f-443e-bdae-a32405132875 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:00.398533 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-68be2962-b62f-443e-bdae-a32405132875 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1574 microversion: 2.1 time: 0.177611 Jun 30 13:14:00.399093 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 396/789] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:00 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:01.417069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c073f31b-83be-4a22-955a-ca46a87bc336 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:01.417762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c073f31b-83be-4a22-955a-ca46a87bc336 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:01.424764 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c073f31b-83be-4a22-955a-ca46a87bc336 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:01.425204 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c073f31b-83be-4a22-955a-ca46a87bc336 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:01.425962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c073f31b-83be-4a22-955a-ca46a87bc336 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:01.426437 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c073f31b-83be-4a22-955a-ca46a87bc336 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:01.562366 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c073f31b-83be-4a22-955a-ca46a87bc336 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:01.570078 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c073f31b-83be-4a22-955a-ca46a87bc336 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1561 microversion: 2.1 time: 0.157382 Jun 30 13:14:01.570675 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 394/790] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:01 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:21.160302 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13d3296c-00a4-4e3a-a329-b51bccb3d807 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:21.160918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-13d3296c-00a4-4e3a-a329-b51bccb3d807 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:21.163024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=5 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:21.163674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=56 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:21.169609 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13d3296c-00a4-4e3a-a329-b51bccb3d807 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:21.170054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13d3296c-00a4-4e3a-a329-b51bccb3d807 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:21.170842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13d3296c-00a4-4e3a-a329-b51bccb3d807 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:21.171269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13d3296c-00a4-4e3a-a329-b51bccb3d807 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:21.196413 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13d3296c-00a4-4e3a-a329-b51bccb3d807 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/ips" status: 200 len: 151 microversion: 2.1 time: 0.041691 Jun 30 13:14:21.197002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 397/791] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:14:21 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:22.554815 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c7c90783-ea26-4c61-ba1c-2c04ccc17889 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40e35279-50a5-4940-8875-52455e5b54ab"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:22.556012 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c7c90783-ea26-4c61-ba1c-2c04ccc17889 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:22.558300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:22.558990 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=60 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:22.564438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c90783-ea26-4c61-ba1c-2c04ccc17889 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:22.564906 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c90783-ea26-4c61-ba1c-2c04ccc17889 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:22.565686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c90783-ea26-4c61-ba1c-2c04ccc17889 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:22.566103 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c90783-ea26-4c61-ba1c-2c04ccc17889 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:22.837281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c7c90783-ea26-4c61-ba1c-2c04ccc17889 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287079 Jun 30 13:14:22.838120 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 395/792] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:14:22 2022] POST /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:23.996552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-65df036b-4fa6-461c-aad9-6ed462256596 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:23.997199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-65df036b-4fa6-461c-aad9-6ed462256596 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:24.003910 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65df036b-4fa6-461c-aad9-6ed462256596 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:24.004473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65df036b-4fa6-461c-aad9-6ed462256596 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:24.005392 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65df036b-4fa6-461c-aad9-6ed462256596 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:24.005913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65df036b-4fa6-461c-aad9-6ed462256596 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:24.029587 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-65df036b-4fa6-461c-aad9-6ed462256596 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/ips" status: 200 len: 150 microversion: 2.20 time: 0.036951 Jun 30 13:14:24.030149 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 398/793] 10.222.0.49 () {60 vars in 1288 bytes} [Thu Jun 30 13:14:23 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 13:14:25.919859 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b543f840-5f7d-402a-a59a-e61567b74072 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:25.920708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b543f840-5f7d-402a-a59a-e61567b74072 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:25.927400 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b543f840-5f7d-402a-a59a-e61567b74072 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:25.927952 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b543f840-5f7d-402a-a59a-e61567b74072 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:25.928790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b543f840-5f7d-402a-a59a-e61567b74072 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:25.929741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b543f840-5f7d-402a-a59a-e61567b74072 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:25.954223 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-b543f840-5f7d-402a-a59a-e61567b74072 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lazy-loading 'flavor' on Instance uuid 9860955c-dc0e-4b24-b696-9de9453da561 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:14:26.232495 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b543f840-5f7d-402a-a59a-e61567b74072 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/action" status: 202 len: 0 microversion: 2.20 time: 0.317580 Jun 30 13:14:26.233116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 396/794] 10.222.0.49 () {62 vars in 1318 bytes} [Thu Jun 30 13:14:25 2022] POST /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:14:26.243634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:26.244331 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:26.250941 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:26.251389 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:26.252142 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:26.252598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:26.394147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:26.402814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:26.404359 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:26.405467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d5a6af8c-d9c4-41ca-85e2-fcb483bbc21f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.167496 Jun 30 13:14:26.406027 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 399/795] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:26 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:27.427081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:27.427769 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:27.434972 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:27.435406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:27.436154 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:27.436569 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:27.580614 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:27.589234 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:27.590760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:27.591907 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-20dde1cd-9932-41d3-a1d9-eff1e0fbd515 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.169999 Jun 30 13:14:27.592468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 397/796] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:27 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:28.613332 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:28.613906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:28.623982 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:28.624609 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:28.625703 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:28.626236 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:28.772078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:28.783947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:28.786130 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:28.787531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b745a58b-b575-45c2-98ad-fca6b9b759fb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.180711 Jun 30 13:14:28.788092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 400/797] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:28 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:29.811989 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:29.812639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:29.819505 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:29.820000 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:29.820878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:29.821391 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:29.967662 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:29.976125 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:29.977715 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:29.979063 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-243b207f-7683-4ac9-8d9c-a593895c0b1e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.171948 Jun 30 13:14:29.979630 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 398/798] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:29 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:30.368947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40e35279-50a5-4940-8875-52455e5b54ab"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:30.370406 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:30.377384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:30.377820 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:30.378606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:30.379031 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:30.464419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Invalid volume: volume 40e35279-50a5-4940-8875-52455e5b54ab is already attached to instances: 74c42415-7a22-43a3-a838-5bf551bec846 Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: POST /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments HTTP/1.1 Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 74 Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:14:30.466244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {"volumeAttachment": {"volumeId": "40e35279-50a5-4940-8875-52455e5b54ab"}} Jun 30 13:14:30.467579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Invalid volume: volume 40e35279-50a5-4940-8875-52455e5b54ab is already attached to instances: 74c42415-7a22-43a3-a838-5bf551bec846 Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '74c42415-7a22-43a3-a838-5bf551bec846', 'body': {'volumeAttachment': {'volumeId': '40e35279-50a5-4940-8875-52455e5b54ab'}}} Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 40e35279-50a5-4940-8875-52455e5b54ab is already attached to instances: 74c42415-7a22-43a3-a838-5bf551bec846 Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:14:30.468303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 40e35279-50a5-4940-8875-52455e5b54ab is already attached to instances: 74c42415-7a22-43a3-a838-5bf551bec846 Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:14:30.470563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:14:30.472385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:14:30.472385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:14:30.472385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:14:30.472385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 40e35279-50a5-4940-8875-52455e5b54ab is already attached to instances: 74c42415-7a22-43a3-a838-5bf551bec846 Jun 30 13:14:30.472385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:14:30.472385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 400 to user: Invalid volume: volume 40e35279-50a5-4940-8875-52455e5b54ab is already attached to instances: 74c42415-7a22-43a3-a838-5bf551bec846 {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:14:30.472385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e91694bc-320b-4d63-b81e-d6a2ce0895ba tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105274 Jun 30 13:14:30.472385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 401/799] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:14:30 2022] POST /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:14:30.530524 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-39b7d7ce-5a00-4933-8051-15f47ae01812 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:30.531013 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-39b7d7ce-5a00-4933-8051-15f47ae01812 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:30.537302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-39b7d7ce-5a00-4933-8051-15f47ae01812 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:30.537749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-39b7d7ce-5a00-4933-8051-15f47ae01812 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:30.538538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-39b7d7ce-5a00-4933-8051-15f47ae01812 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:30.538962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-39b7d7ce-5a00-4933-8051-15f47ae01812 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:30.624476 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-39b7d7ce-5a00-4933-8051-15f47ae01812 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'services' on Instance uuid 74c42415-7a22-43a3-a838-5bf551bec846 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:14:30.703839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-39b7d7ce-5a00-4933-8051-15f47ae01812 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments/40e35279-50a5-4940-8875-52455e5b54ab" status: 202 len: 0 microversion: 2.1 time: 0.177795 Jun 30 13:14:30.704524 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 399/800] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:14:30 2022] DELETE /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments/40e35279-50a5-4940-8875-52455e5b54ab => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:14:30.713521 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19b2e62b-ccbe-42a6-8b11-d41194c91c13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:30.714515 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19b2e62b-ccbe-42a6-8b11-d41194c91c13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:30.720985 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19b2e62b-ccbe-42a6-8b11-d41194c91c13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:30.721422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19b2e62b-ccbe-42a6-8b11-d41194c91c13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:30.722360 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19b2e62b-ccbe-42a6-8b11-d41194c91c13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:30.722805 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19b2e62b-ccbe-42a6-8b11-d41194c91c13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:30.755477 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19b2e62b-ccbe-42a6-8b11-d41194c91c13 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Jun 30 13:14:30.756031 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 402/801] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:14:30 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:14:30.998919 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:30.999496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:31.007325 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:31.007899 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:31.009036 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:31.009599 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:31.153222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:31.164382 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:31.165971 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:31.167268 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-670ca65c-e913-40c1-be5c-c90f11d4e308 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.173794 Jun 30 13:14:31.168387 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 400/802] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:30 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:31.767702 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1edcdc15-c801-40ac-80aa-5a27e6cd41ec tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:31.768814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1edcdc15-c801-40ac-80aa-5a27e6cd41ec tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:31.777719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1edcdc15-c801-40ac-80aa-5a27e6cd41ec tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:31.778391 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1edcdc15-c801-40ac-80aa-5a27e6cd41ec tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:31.779603 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1edcdc15-c801-40ac-80aa-5a27e6cd41ec tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:31.780243 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1edcdc15-c801-40ac-80aa-5a27e6cd41ec tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:31.811399 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1edcdc15-c801-40ac-80aa-5a27e6cd41ec tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047858 Jun 30 13:14:31.812128 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 403/803] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:14:31 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:14:31.877296 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e535b3b1-7ee4-480a-8d32-62a9deddd9c6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:31.877864 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e535b3b1-7ee4-480a-8d32-62a9deddd9c6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:31.884614 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e535b3b1-7ee4-480a-8d32-62a9deddd9c6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:31.885044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e535b3b1-7ee4-480a-8d32-62a9deddd9c6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:31.885799 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e535b3b1-7ee4-480a-8d32-62a9deddd9c6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:31.886221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e535b3b1-7ee4-480a-8d32-62a9deddd9c6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:31.914526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e535b3b1-7ee4-480a-8d32-62a9deddd9c6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:14:32.006367 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e535b3b1-7ee4-480a-8d32-62a9deddd9c6 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 204 len: 0 microversion: 2.1 time: 0.133197 Jun 30 13:14:32.007124 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 401/804] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:14:31 2022] DELETE /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 13:14:32.017271 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d88e0389-bab7-4487-8fca-ab6bea13edd4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:32.017871 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d88e0389-bab7-4487-8fca-ab6bea13edd4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:32.026352 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d88e0389-bab7-4487-8fca-ab6bea13edd4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:32.026935 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d88e0389-bab7-4487-8fca-ab6bea13edd4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:32.027722 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d88e0389-bab7-4487-8fca-ab6bea13edd4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:32.028149 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d88e0389-bab7-4487-8fca-ab6bea13edd4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:32.164471 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d88e0389-bab7-4487-8fca-ab6bea13edd4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:32.172519 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d88e0389-bab7-4487-8fca-ab6bea13edd4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1683 microversion: 2.1 time: 0.160562 Jun 30 13:14:32.173094 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 404/805] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:32 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:32.185701 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:32.186416 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:32.193285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:32.193970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:32.194780 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:32.195242 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:32.336738 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:32.349544 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:32.351738 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:32.353486 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-784534bd-5495-487d-a7fb-3e852e030b7f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.171864 Jun 30 13:14:32.354342 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 402/806] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:32 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:33.191752 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7a3095e1-e21c-4f4c-b19e-4e41b1fcd10b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:33.192353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7a3095e1-e21c-4f4c-b19e-4e41b1fcd10b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:33.199411 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a3095e1-e21c-4f4c-b19e-4e41b1fcd10b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:33.199843 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a3095e1-e21c-4f4c-b19e-4e41b1fcd10b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:33.203049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a3095e1-e21c-4f4c-b19e-4e41b1fcd10b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:33.203486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7a3095e1-e21c-4f4c-b19e-4e41b1fcd10b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:33.344424 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7a3095e1-e21c-4f4c-b19e-4e41b1fcd10b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:33.352511 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7a3095e1-e21c-4f4c-b19e-4e41b1fcd10b tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1683 microversion: 2.1 time: 0.164993 Jun 30 13:14:33.353068 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 405/807] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:33 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:33.373106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:33.373917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:33.381940 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:33.382405 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:33.383177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:33.383596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:33.530993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:33.539314 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:33.540860 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:33.542034 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6bade55b-7985-461c-ba78-0011f27798ce tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.172997 Jun 30 13:14:33.542634 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 403/808] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:33 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:34.370786 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7eea2f48-5960-495b-9148-2d56b2faf047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:34.371426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7eea2f48-5960-495b-9148-2d56b2faf047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:34.379511 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eea2f48-5960-495b-9148-2d56b2faf047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:34.379949 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eea2f48-5960-495b-9148-2d56b2faf047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:34.380719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eea2f48-5960-495b-9148-2d56b2faf047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:34.381146 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7eea2f48-5960-495b-9148-2d56b2faf047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:34.525979 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7eea2f48-5960-495b-9148-2d56b2faf047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:34.534045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7eea2f48-5960-495b-9148-2d56b2faf047 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1683 microversion: 2.1 time: 0.167018 Jun 30 13:14:34.534653 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 406/809] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:34 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:34.561119 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:34.561702 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:34.568513 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:34.569069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:34.569860 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:34.570338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:34.786943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:34.795451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:34.797069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:34.798597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-deed206f-ab91-42b2-9451-e0152027464f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.241304 Jun 30 13:14:34.799169 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 404/810] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:34 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:35.191394 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-91c38bf9-3cdc-4a81-99fa-374c3898f4f8 req-41614cde-7fb2-4842-ad97-cf3b44cf8ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c42415-7a22-43a3-a838-5bf551bec846", "name": "network-vif-deleted", "tag": "39420333-9a35-4720-af7e-4064bfe6cdd7"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:35.200975 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-91c38bf9-3cdc-4a81-99fa-374c3898f4f8 req-41614cde-7fb2-4842-ad97-cf3b44cf8ec7 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:35.201605 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-91c38bf9-3cdc-4a81-99fa-374c3898f4f8 req-41614cde-7fb2-4842-ad97-cf3b44cf8ec7 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:35.216606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-91c38bf9-3cdc-4a81-99fa-374c3898f4f8 req-41614cde-7fb2-4842-ad97-cf3b44cf8ec7 service nova] Creating event network-vif-deleted:39420333-9a35-4720-af7e-4064bfe6cdd7 for instance 74c42415-7a22-43a3-a838-5bf551bec846 on hv-cinder-81268 Jun 30 13:14:35.222791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-91c38bf9-3cdc-4a81-99fa-374c3898f4f8 req-41614cde-7fb2-4842-ad97-cf3b44cf8ec7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035393 Jun 30 13:14:35.227013 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 407/811] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:35.559615 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:35.560405 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:35.568622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:35.569247 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:35.569924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:35.570534 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:35.608488 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:35.608918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:35.609389 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'fault' on Instance uuid 74c42415-7a22-43a3-a838-5bf551bec846 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:14:35.612216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:35.656902 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:35.667039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cb2dceff-28e0-4c04-82e9-150155736d5d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 200 len: 1331 microversion: 2.1 time: 0.119372 Jun 30 13:14:35.667974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 405/812] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:35 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:35.818807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:35.819493 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:35.825904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:35.826447 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:35.827203 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:35.827636 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:35.967232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:35.976403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:35.977918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:35.979144 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e47115a6-c30b-4a58-9e6a-1af945938240 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.165162 Jun 30 13:14:35.979697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 408/813] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:35 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:36.688297 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:36.689220 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:36.700438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:36.701049 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:36.702416 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:36.703138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:36.717109 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 HTTP/1.1 Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:14:36.718779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:14:36.720844 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '74c42415-7a22-43a3-a838-5bf551bec846'} Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:14:36.721638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:14:36.723088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:14:36.724623 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:14:36.724623 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-55be1eb1-e4dc-417d-ac0a-c4e855a29bd2 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 404 len: 111 microversion: 2.1 time: 0.038717 Jun 30 13:14:36.724623 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 406/814] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:36 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:14:36.729443 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d76b70a0-e1e6-454f-9837-fc4131bcf14a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '.version_select at 0x7f4b9f72f820>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:36.750807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d76b70a0-e1e6-454f-9837-fc4131bcf14a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-295470655" status: 202 len: 0 microversion: 2.1 time: 0.025068 Jun 30 13:14:36.751340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 409/815] 10.222.0.49 () {58 vars in 1217 bytes} [Thu Jun 30 13:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-295470655 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:14:36.998129 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:36.998803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:37.005780 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:37.006309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:37.007166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:37.007663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:37.217166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:37.226640 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:37.228131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:37.229282 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-98ed5d65-f321-4244-aa5e-11e35bc26a50 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.235255 Jun 30 13:14:37.229840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 407/816] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:36 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:37.461087 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7871b4a6-15be-4538-867a-b2c06e5dedc7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: .version_select at 0x7f4b9ff4be50>, body: {"keypair": {"name": "tempest-keypair-1554972407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf8PlYb2wwpSeFyWXwcVLR930N3IAPXNFrmLrGbpdlV8iwZ4g8oLZoH3Z/i9C8HEGTzebb98hid9Hg8X/0DL/juVFMpDeNgG+WSguniaNi+JfOxibuaxmk1g8xmqr71dA=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:37.477343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-7871b4a6-15be-4538-867a-b2c06e5dedc7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for project fb73f41e81224744800e167e0eb69863. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:14:37.482447 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-7871b4a6-15be-4538-867a-b2c06e5dedc7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for user 126e2b6fc7114ec3bdc1bb3a99fcf752 and project fb73f41e81224744800e167e0eb69863. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:14:37.508774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7871b4a6-15be-4538-867a-b2c06e5dedc7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051559 Jun 30 13:14:37.516045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 410/817] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:14:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:38.249183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:38.250003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:38.259373 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:38.259923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:38.260810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:38.261468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:38.564669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:38.575010 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:38.577126 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:38.578688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e6ecd85a-2921-488d-9c92-28b52613d27f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.333392 Jun 30 13:14:38.580460 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 408/818] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:38 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:39.095490 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1590840957", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2789cdc0-70d1-47d5-9191-eacc6cd13622"}], "security_groups": [{"name": "tempest-securitygroup--211584541"}], "key_name": "tempest-keypair-1554972407", "user_data": "}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:39.199936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] validate_networks() for [('2789cdc0-70d1-47d5-9191-eacc6cd13622', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:14:39.597669 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:39.598238 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:39.605642 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:39.606075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:39.606874 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:39.607294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:39.682018 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:14:39.682504 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:14:39.682973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:14:39.683374 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:14:39.683773 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:14:39.692978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:39.693494 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:39.694461 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:39.694862 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:39.712631 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for project fb73f41e81224744800e167e0eb69863. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:14:39.716580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Getting quotas for user 126e2b6fc7114ec3bdc1bb3a99fcf752 and project fb73f41e81224744800e167e0eb69863. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:14:39.727963 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:14:39.730185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:14:39.737401 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:39.746204 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:39.748437 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:39.749685 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5961a29d-5869-4aa8-a6fc-3acc96da8221 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.156482 Jun 30 13:14:39.750374 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 409/819] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:39 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:39.779851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-741fe3e1-1fbb-476d-b46d-5ea4705aab7a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689639 Jun 30 13:14:39.780484 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 411/820] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:14:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:14:39.790671 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0f55286f-b5f2-47be-bf23-fd0105b1f087 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:39.791369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0f55286f-b5f2-47be-bf23-fd0105b1f087 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:39.843308 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0f55286f-b5f2-47be-bf23-fd0105b1f087 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:39.850776 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0f55286f-b5f2-47be-bf23-fd0105b1f087 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1242 microversion: 2.1 time: 0.063860 Jun 30 13:14:39.851338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 410/821] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:39 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:40.770554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:40.771194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:40.777646 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:40.778153 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:40.779062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:40.779489 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:40.868309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a6e12d97-3ca3-48d2-b4b6-befcb40344cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:40.869509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a6e12d97-3ca3-48d2-b4b6-befcb40344cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:40.878920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a6e12d97-3ca3-48d2-b4b6-befcb40344cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:40.879653 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a6e12d97-3ca3-48d2-b4b6-befcb40344cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:40.880596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a6e12d97-3ca3-48d2-b4b6-befcb40344cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:40.881161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a6e12d97-3ca3-48d2-b4b6-befcb40344cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:40.926757 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:40.936382 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:40.937938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:40.939199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ca76fbed-06f2-4788-bc6f-2c1a3f480a90 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.173800 Jun 30 13:14:40.939898 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 412/822] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:40 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:40.966479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a6e12d97-3ca3-48d2-b4b6-befcb40344cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:40.974621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a6e12d97-3ca3-48d2-b4b6-befcb40344cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1302 microversion: 2.1 time: 0.110494 Jun 30 13:14:40.975179 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 411/823] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:40 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:14:41.957848 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:41.958438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:41.964924 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:41.965370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:41.966131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:41.966641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:41.992503 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-21d5222f-d795-4e44-80cc-e4cd337fe514 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:41.993093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-21d5222f-d795-4e44-80cc-e4cd337fe514 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:42.000037 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-21d5222f-d795-4e44-80cc-e4cd337fe514 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:42.000479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-21d5222f-d795-4e44-80cc-e4cd337fe514 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:42.001454 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-21d5222f-d795-4e44-80cc-e4cd337fe514 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:42.002096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-21d5222f-d795-4e44-80cc-e4cd337fe514 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:42.102355 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:42.110870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:42.112501 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:42.113646 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4df609e4-bd33-4e5d-867c-8ede592b5905 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.159935 Jun 30 13:14:42.114202 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 413/824] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:41 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:42.217656 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-21d5222f-d795-4e44-80cc-e4cd337fe514 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:42.228856 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-21d5222f-d795-4e44-80cc-e4cd337fe514 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.240502 Jun 30 13:14:42.229414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 412/825] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:41 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:42.441205 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-83b94fbb-5808-41bd-896f-e1d890949daf req-3db4a9d8-b513-4b6e-9c3d-8f22351a3292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73d4484-c128-4beb-a9dc-602509d79178", "tag": "b01b7382-16fd-4fb5-822c-a375652dd0fe"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:42.451219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-83b94fbb-5808-41bd-896f-e1d890949daf req-3db4a9d8-b513-4b6e-9c3d-8f22351a3292 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:42.451967 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-83b94fbb-5808-41bd-896f-e1d890949daf req-3db4a9d8-b513-4b6e-9c3d-8f22351a3292 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:42.464083 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-83b94fbb-5808-41bd-896f-e1d890949daf req-3db4a9d8-b513-4b6e-9c3d-8f22351a3292 service nova] Creating event network-changed:b01b7382-16fd-4fb5-822c-a375652dd0fe for instance c73d4484-c128-4beb-a9dc-602509d79178 on hv-cinder-81268 Jun 30 13:14:42.469676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-83b94fbb-5808-41bd-896f-e1d890949daf req-3db4a9d8-b513-4b6e-9c3d-8f22351a3292 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031995 Jun 30 13:14:42.470230 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 414/826] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:43.133106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:43.133709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:43.140720 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:43.141159 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:43.141923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:43.142349 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:43.247087 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-298731b9-8142-4a2e-b5d7-a96d2c9405df tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:43.247741 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-298731b9-8142-4a2e-b5d7-a96d2c9405df tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:43.254610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-298731b9-8142-4a2e-b5d7-a96d2c9405df tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:43.255025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-298731b9-8142-4a2e-b5d7-a96d2c9405df tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:43.256047 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-298731b9-8142-4a2e-b5d7-a96d2c9405df tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:43.256481 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-298731b9-8142-4a2e-b5d7-a96d2c9405df tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:43.341736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:43.350454 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:43.351941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:43.353101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-946e9085-82d4-42fc-89e5-7abc46afd9c1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.224059 Jun 30 13:14:43.353697 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 413/827] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:43 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:43.389782 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-298731b9-8142-4a2e-b5d7-a96d2c9405df tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:43.397384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-298731b9-8142-4a2e-b5d7-a96d2c9405df tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.155245 Jun 30 13:14:43.397961 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 415/828] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:43 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:44.375949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:44.376942 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:44.384320 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:44.384754 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:44.385500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:44.385920 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:44.414899 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e5259fd2-70de-4d5a-8d99-9d33184daf48 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:44.415458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e5259fd2-70de-4d5a-8d99-9d33184daf48 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:44.422252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5259fd2-70de-4d5a-8d99-9d33184daf48 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:44.422712 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5259fd2-70de-4d5a-8d99-9d33184daf48 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:44.423685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5259fd2-70de-4d5a-8d99-9d33184daf48 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:44.424110 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5259fd2-70de-4d5a-8d99-9d33184daf48 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:44.521295 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:44.529344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:44.530843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:44.531991 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bf111596-a740-40d1-b2bd-c11c747bfa42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.162732 Jun 30 13:14:44.532540 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 414/829] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:44 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:44.564576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e5259fd2-70de-4d5a-8d99-9d33184daf48 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:44.571927 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e5259fd2-70de-4d5a-8d99-9d33184daf48 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.160889 Jun 30 13:14:44.572493 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 416/830] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:44 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:45.551193 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:45.551937 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:45.559057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:45.559503 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:45.560255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:45.560698 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:45.589315 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-70fa1c27-bcac-4ad9-9803-0ae0bbb14059 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:45.590698 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-70fa1c27-bcac-4ad9-9803-0ae0bbb14059 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:45.598488 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70fa1c27-bcac-4ad9-9803-0ae0bbb14059 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:45.599185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70fa1c27-bcac-4ad9-9803-0ae0bbb14059 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:45.600151 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70fa1c27-bcac-4ad9-9803-0ae0bbb14059 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:45.600727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-70fa1c27-bcac-4ad9-9803-0ae0bbb14059 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:45.706235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:45.715350 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:45.716895 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:45.718138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e93f86a5-94ee-4fe1-ad4b-923ab15540e6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.171358 Jun 30 13:14:45.718832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 415/831] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:45 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:45.735438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-70fa1c27-bcac-4ad9-9803-0ae0bbb14059 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:45.743402 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-70fa1c27-bcac-4ad9-9803-0ae0bbb14059 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.158015 Jun 30 13:14:45.743969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 417/832] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:45 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:46.741590 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:46.742747 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:46.753594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:46.754037 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:46.754838 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:46.755235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:46.760495 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-13e7fc92-6e1f-4bb4-9bfc-17c17cfa9fed tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:46.761841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-13e7fc92-6e1f-4bb4-9bfc-17c17cfa9fed tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:46.768485 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13e7fc92-6e1f-4bb4-9bfc-17c17cfa9fed tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:46.769014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13e7fc92-6e1f-4bb4-9bfc-17c17cfa9fed tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:46.770604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13e7fc92-6e1f-4bb4-9bfc-17c17cfa9fed tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:46.770604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-13e7fc92-6e1f-4bb4-9bfc-17c17cfa9fed tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:46.774733 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:46.887380 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:46.895542 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:46.897017 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:46.898175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-96cc110c-cf03-421e-807a-044afa02f03e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.163666 Jun 30 13:14:46.898755 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 416/833] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:46 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:46.902753 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-13e7fc92-6e1f-4bb4-9bfc-17c17cfa9fed tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:46.910419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-13e7fc92-6e1f-4bb4-9bfc-17c17cfa9fed tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.153883 Jun 30 13:14:46.910978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 418/834] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:46 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:47.568171 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-92708c2b-3071-4325-a590-087fef527ea9 req-67cc3bca-38d1-4a59-b778-f0d943b71f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9860955c-dc0e-4b24-b696-9de9453da561", "name": "network-vif-plugged", "status": "completed", "tag": "4a99638e-5bc5-455f-b4cc-97801113ceea"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:47.577369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-92708c2b-3071-4325-a590-087fef527ea9 req-67cc3bca-38d1-4a59-b778-f0d943b71f63 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:47.577779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-92708c2b-3071-4325-a590-087fef527ea9 req-67cc3bca-38d1-4a59-b778-f0d943b71f63 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:47.589403 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-92708c2b-3071-4325-a590-087fef527ea9 req-67cc3bca-38d1-4a59-b778-f0d943b71f63 service nova] Creating event network-vif-plugged:4a99638e-5bc5-455f-b4cc-97801113ceea for instance 9860955c-dc0e-4b24-b696-9de9453da561 on hv-cinder-81268 Jun 30 13:14:47.594837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-92708c2b-3071-4325-a590-087fef527ea9 req-67cc3bca-38d1-4a59-b778-f0d943b71f63 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030291 Jun 30 13:14:47.595598 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 417/835] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:47.916815 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:47.917426 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:47.924720 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:47.925390 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:47.926414 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:47.926842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:47.928510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c5d02b08-3e74-4d3f-a60d-f07a58b2e8ac tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:47.929216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c5d02b08-3e74-4d3f-a60d-f07a58b2e8ac tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:47.936299 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c5d02b08-3e74-4d3f-a60d-f07a58b2e8ac tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:47.936731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c5d02b08-3e74-4d3f-a60d-f07a58b2e8ac tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:47.937510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c5d02b08-3e74-4d3f-a60d-f07a58b2e8ac tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:47.937935 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c5d02b08-3e74-4d3f-a60d-f07a58b2e8ac tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:48.064163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:48.073313 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:48.075089 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:48.076247 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a6ad0faf-c020-4764-9169-78388dcf8142 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.163450 Jun 30 13:14:48.076786 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 419/836] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:47 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:48.079995 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c5d02b08-3e74-4d3f-a60d-f07a58b2e8ac tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:48.089167 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c5d02b08-3e74-4d3f-a60d-f07a58b2e8ac tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.165498 Jun 30 13:14:48.089749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 418/837] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:47 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:49.100535 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:49.101233 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:49.107051 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9774d99a-9fa6-4a6d-a0b8-c72684640869 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:49.107655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9774d99a-9fa6-4a6d-a0b8-c72684640869 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:49.109714 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:49.110241 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:49.111158 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:49.111563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:49.114216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9774d99a-9fa6-4a6d-a0b8-c72684640869 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:49.117071 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9774d99a-9fa6-4a6d-a0b8-c72684640869 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:49.117256 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9774d99a-9fa6-4a6d-a0b8-c72684640869 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:49.117690 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9774d99a-9fa6-4a6d-a0b8-c72684640869 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:49.252334 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:49.266731 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:49.269685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:49.271994 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2a74419e-63ec-4d99-9f74-983ceb0b47da tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.177641 Jun 30 13:14:49.274077 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 420/838] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:49 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:49.275599 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9774d99a-9fa6-4a6d-a0b8-c72684640869 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:49.284643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9774d99a-9fa6-4a6d-a0b8-c72684640869 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.181674 Jun 30 13:14:49.285232 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 419/839] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:49 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:50.292986 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:50.293670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:50.296011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:50.296978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=10 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:50.301760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e2dba329-7e73-4f72-98de-3fb4b84a9bc5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:50.303101 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e2dba329-7e73-4f72-98de-3fb4b84a9bc5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:50.303298 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:50.303627 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:50.304972 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:50.305468 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:50.305581 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:50.311809 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2dba329-7e73-4f72-98de-3fb4b84a9bc5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:50.312248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2dba329-7e73-4f72-98de-3fb4b84a9bc5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:50.313259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2dba329-7e73-4f72-98de-3fb4b84a9bc5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:50.313658 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2dba329-7e73-4f72-98de-3fb4b84a9bc5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:50.490437 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:50.499154 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e2dba329-7e73-4f72-98de-3fb4b84a9bc5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:50.504252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:50.506157 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:50.507360 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-09e7a23b-c06e-4161-bec9-7d2e6900aaab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.218720 Jun 30 13:14:50.507761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e2dba329-7e73-4f72-98de-3fb4b84a9bc5 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.210258 Jun 30 13:14:50.508376 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 421/840] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:50 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:50.510963 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 420/841] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:50 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:51.527783 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:51.528440 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ea262470-7cba-426c-a44e-c7491861d562 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:51.528920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:51.529041 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ea262470-7cba-426c-a44e-c7491861d562 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:51.530880 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:51.535765 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ea262470-7cba-426c-a44e-c7491861d562 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:51.536179 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ea262470-7cba-426c-a44e-c7491861d562 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:51.536722 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:51.536931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ea262470-7cba-426c-a44e-c7491861d562 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:51.537163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:51.537351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ea262470-7cba-426c-a44e-c7491861d562 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:51.537925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:51.538383 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:51.668297 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:51.674827 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ea262470-7cba-426c-a44e-c7491861d562 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:51.676864 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:51.678478 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:51.679750 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2dff2a76-2e0f-48f3-a497-248154fc85d5 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.157055 Jun 30 13:14:51.685727 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 422/842] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:51 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:51.685897 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ea262470-7cba-426c-a44e-c7491861d562 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.158599 Jun 30 13:14:51.685897 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 421/843] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:51 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:14:51.996368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-ae893805-82a6-45bc-a0c2-e3d545790bee req-e542d4a1-07f7-49a7-a6f3-e2406e113a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73d4484-c128-4beb-a9dc-602509d79178", "name": "network-vif-plugged", "status": "completed", "tag": "b01b7382-16fd-4fb5-822c-a375652dd0fe"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:14:52.004745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ae893805-82a6-45bc-a0c2-e3d545790bee req-e542d4a1-07f7-49a7-a6f3-e2406e113a8a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:52.005187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-ae893805-82a6-45bc-a0c2-e3d545790bee req-e542d4a1-07f7-49a7-a6f3-e2406e113a8a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:52.016664 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-ae893805-82a6-45bc-a0c2-e3d545790bee req-e542d4a1-07f7-49a7-a6f3-e2406e113a8a service nova] Creating event network-vif-plugged:b01b7382-16fd-4fb5-822c-a375652dd0fe for instance c73d4484-c128-4beb-a9dc-602509d79178 on hv-cinder-81268 Jun 30 13:14:52.021751 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-ae893805-82a6-45bc-a0c2-e3d545790bee req-e542d4a1-07f7-49a7-a6f3-e2406e113a8a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029141 Jun 30 13:14:52.022413 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 423/844] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:52.702727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:52.703702 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:52.704850 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c9c6f444-c7ed-46ac-b81d-925ed4c955f7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:52.706001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c9c6f444-c7ed-46ac-b81d-925ed4c955f7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:52.708155 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:52.715359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:52.715516 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9c6f444-c7ed-46ac-b81d-925ed4c955f7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:52.715820 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:52.715936 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9c6f444-c7ed-46ac-b81d-925ed4c955f7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:52.716591 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9c6f444-c7ed-46ac-b81d-925ed4c955f7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:52.716724 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:52.717011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:52.717160 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c9c6f444-c7ed-46ac-b81d-925ed4c955f7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:52.855213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:52.856170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c9c6f444-c7ed-46ac-b81d-925ed4c955f7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:52.863519 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:52.863904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c9c6f444-c7ed-46ac-b81d-925ed4c955f7 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.167024 Jun 30 13:14:52.864629 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 424/845] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:52 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:52.875262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:52.876416 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ddd67236-00ec-4094-939b-d6efa0ac7fd2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.180614 Jun 30 13:14:52.877011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 422/846] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:52 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:53.885740 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6af5aa74-6d11-4d22-b100-6f368d94d660 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:53.886339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6af5aa74-6d11-4d22-b100-6f368d94d660 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:53.893123 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6af5aa74-6d11-4d22-b100-6f368d94d660 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:53.893555 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6af5aa74-6d11-4d22-b100-6f368d94d660 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:53.894337 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6af5aa74-6d11-4d22-b100-6f368d94d660 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:53.894447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:53.894854 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6af5aa74-6d11-4d22-b100-6f368d94d660 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:53.895006 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:53.901947 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:53.902414 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:53.903173 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:53.903594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:54.027062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6af5aa74-6d11-4d22-b100-6f368d94d660 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:54.030790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:54.034638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6af5aa74-6d11-4d22-b100-6f368d94d660 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.154820 Jun 30 13:14:54.035199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 425/847] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:53 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:54.039219 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:54.040737 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:54.041923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-43e27429-f208-4b34-bb40-4176e06a3cae tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.151596 Jun 30 13:14:54.043894 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 423/848] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:53 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:55.055833 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8122d327-a3d1-4605-b82d-143acf11c702 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:55.056681 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8122d327-a3d1-4605-b82d-143acf11c702 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:55.061144 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:55.061739 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:55.063651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8122d327-a3d1-4605-b82d-143acf11c702 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:55.064097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8122d327-a3d1-4605-b82d-143acf11c702 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:55.064858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8122d327-a3d1-4605-b82d-143acf11c702 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:55.065287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8122d327-a3d1-4605-b82d-143acf11c702 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:55.068621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:55.069021 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:55.069800 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:55.070218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:55.088642 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:14:55.201294 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8122d327-a3d1-4605-b82d-143acf11c702 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:55.202727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:55.208932 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8122d327-a3d1-4605-b82d-143acf11c702 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.159770 Jun 30 13:14:55.209501 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 426/849] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:55 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:55.210714 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:55.212207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:55.213366 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-54c0652b-ed70-45f9-acf1-4e4168458d6a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.156154 Jun 30 13:14:55.213911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 424/850] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:55 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:56.229065 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9975bbe3-81b3-447e-b8fc-8039534b3f0c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:56.229813 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9975bbe3-81b3-447e-b8fc-8039534b3f0c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:56.234466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:56.235070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:56.240205 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9975bbe3-81b3-447e-b8fc-8039534b3f0c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:56.240729 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9975bbe3-81b3-447e-b8fc-8039534b3f0c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:56.241499 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9975bbe3-81b3-447e-b8fc-8039534b3f0c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:56.241926 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9975bbe3-81b3-447e-b8fc-8039534b3f0c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:56.243846 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:56.244289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:56.245062 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:56.245479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:56.372757 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9975bbe3-81b3-447e-b8fc-8039534b3f0c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:56.373891 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:56.380585 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9975bbe3-81b3-447e-b8fc-8039534b3f0c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.157304 Jun 30 13:14:56.381145 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 427/851] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:56 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:56.381886 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:56.383401 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:56.384898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ab042e9e-5e7d-457d-b2d6-6ea651366029 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.156259 Jun 30 13:14:56.386175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 425/852] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:56 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:57.401849 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d8a0292e-c0c8-413b-b61a-b61cd90fbaeb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:57.402915 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d8a0292e-c0c8-413b-b61a-b61cd90fbaeb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:57.411221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:57.412138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:57.413142 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8a0292e-c0c8-413b-b61a-b61cd90fbaeb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:57.413882 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8a0292e-c0c8-413b-b61a-b61cd90fbaeb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:57.415223 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8a0292e-c0c8-413b-b61a-b61cd90fbaeb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:57.415889 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d8a0292e-c0c8-413b-b61a-b61cd90fbaeb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:57.420801 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:57.421330 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:57.422086 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:57.422545 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:57.545562 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-d8a0292e-c0c8-413b-b61a-b61cd90fbaeb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:57.553684 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d8a0292e-c0c8-413b-b61a-b61cd90fbaeb tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1367 microversion: 2.1 time: 0.158644 Jun 30 13:14:57.554270 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 428/853] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:57 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:57.554531 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:57.562639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:57.564177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:57.565334 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c573082b-d133-4722-bcce-7c98cdc64ca7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.160844 Jun 30 13:14:57.565879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 426/854] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:57 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:14:58.572923 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6a4530a9-e3cf-4c68-aff9-553f9477e716 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:58.574462 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6a4530a9-e3cf-4c68-aff9-553f9477e716 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:58.584432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:58.584971 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a4530a9-e3cf-4c68-aff9-553f9477e716 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:58.585067 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:58.585475 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a4530a9-e3cf-4c68-aff9-553f9477e716 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:58.586568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a4530a9-e3cf-4c68-aff9-553f9477e716 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:58.587257 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6a4530a9-e3cf-4c68-aff9-553f9477e716 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:58.592081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:58.592527 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:58.593292 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:58.593716 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:58.721768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:58.724350 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6a4530a9-e3cf-4c68-aff9-553f9477e716 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:58.730526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:58.732030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:14:58.732444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6a4530a9-e3cf-4c68-aff9-553f9477e716 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1558 microversion: 2.1 time: 0.165267 Jun 30 13:14:58.732961 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 429/855] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:14:58 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:14:58.733209 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0ca967b8-d8b4-4473-98dc-94cae4ab4d42 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1742 microversion: 2.20 time: 0.153372 Jun 30 13:14:58.733749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 427/856] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:58 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:14:58.748809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-91257edd-a74c-4760-af4d-e74682104441 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:58.749287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-91257edd-a74c-4760-af4d-e74682104441 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:58.755362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91257edd-a74c-4760-af4d-e74682104441 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:58.755785 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91257edd-a74c-4760-af4d-e74682104441 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:58.756588 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91257edd-a74c-4760-af4d-e74682104441 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:58.757009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91257edd-a74c-4760-af4d-e74682104441 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:58.837084 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-91257edd-a74c-4760-af4d-e74682104441 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091697 Jun 30 13:14:58.837843 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 430/857] 10.222.0.49 () {58 vars in 1274 bytes} [Thu Jun 30 13:14:58 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:14:59.752407 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:14:59.755052 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:14:59.762215 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:59.762595 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:14:59.763540 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:14:59.763964 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:00.076572 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:00.085151 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:00.087090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:00.088651 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d36db8ef-27db-4e39-b860-43aec9c57bf6 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.341070 Jun 30 13:15:00.102518 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 428/858] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:14:59 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:00.491603 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-e69bb055-fe6d-406c-a811-051569b49f5f req-d9a3c64c-79c3-446f-a579-2d886f55d4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73d4484-c128-4beb-a9dc-602509d79178", "tag": "b01b7382-16fd-4fb5-822c-a375652dd0fe"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:00.506673 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e69bb055-fe6d-406c-a811-051569b49f5f req-d9a3c64c-79c3-446f-a579-2d886f55d4cf service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:00.510890 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e69bb055-fe6d-406c-a811-051569b49f5f req-d9a3c64c-79c3-446f-a579-2d886f55d4cf service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:00.533606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-e69bb055-fe6d-406c-a811-051569b49f5f req-d9a3c64c-79c3-446f-a579-2d886f55d4cf service nova] Creating event network-changed:b01b7382-16fd-4fb5-822c-a375652dd0fe for instance c73d4484-c128-4beb-a9dc-602509d79178 on hv-cinder-81268 Jun 30 13:15:00.550437 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-e69bb055-fe6d-406c-a811-051569b49f5f req-d9a3c64c-79c3-446f-a579-2d886f55d4cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060433 Jun 30 13:15:00.553385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 431/859] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:01.109608 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:01.110896 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:01.118442 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:01.123005 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:01.131928 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:01.133108 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:01.326360 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:01.350809 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:01.353927 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:01.355682 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cde95b30-0d67-4960-b73c-fd8f6f61e462 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.250143 Jun 30 13:15:01.356247 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 429/860] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:01 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:02.381739 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:02.382476 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:02.393445 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:02.394017 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:02.394996 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:02.395578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:02.547300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:02.559443 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:02.560913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:02.562286 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ad5074c9-9e3c-4381-a5bf-125a5467c00b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.192411 Jun 30 13:15:02.563033 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 432/861] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:02 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:03.580288 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:03.580958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:03.587875 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:03.588566 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:03.589564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:03.590161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:03.753614 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:03.766123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:03.768034 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:03.769576 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-725fdbed-90c7-43d1-9226-c5ffdb74912f tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.193282 Jun 30 13:15:03.780589 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 430/862] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:03 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:04.788500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:04.789180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:04.797993 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:04.798460 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:04.799442 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:04.799862 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:04.997541 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:05.009839 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:05.011873 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:05.013549 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f6a8f12e-b5d9-4903-af37-5fa64b4cced9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.229164 Jun 30 13:15:05.014457 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 433/863] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:04 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:06.037818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:06.038536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:06.050636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:06.051444 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:06.052434 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:06.054793 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:06.253194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:06.268011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:06.268011 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:06.268528 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e91b06b5-2112-44b9-a91b-a72f19204978 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.234136 Jun 30 13:15:06.279138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 431/864] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:06 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:07.289107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:07.290439 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:07.304284 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:07.304731 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:07.306854 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:07.307508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:07.821152 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:07.830561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:07.832522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:07.833985 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b33c35d-e732-4634-99c7-dc4aebc28b58 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.551118 Jun 30 13:15:07.845496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 434/865] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:07 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:08.863134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:08.864935 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:08.879388 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:08.880801 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:08.882888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:08.883625 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:09.076660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:09.086009 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:09.088072 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:09.091501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b9ca328a-65f3-47d9-9545-3d755fb3056e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.242070 Jun 30 13:15:09.103298 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 432/866] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:08 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:10.119499 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:10.121097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:10.138173 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:10.138709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:10.139497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:10.139933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:10.311206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:10.320024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:10.321634 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:10.323079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fdcc6121-4b6d-419e-994f-4b0d86b50759 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1737 microversion: 2.20 time: 0.211682 Jun 30 13:15:10.323748 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 435/867] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:10 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:11.342133 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:11.342945 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:11.352882 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:11.354856 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:11.355869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:11.356297 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:11.662519 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:11.672541 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:11.681583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:11.685700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9ec51bf0-42c7-4f67-b700-273bd21defa7 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1719 microversion: 2.20 time: 0.347620 Jun 30 13:15:11.689648 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 433/868] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:11 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1719 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:12.707846 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:12.714992 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:12.726050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:12.728103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:12.729430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:12.730187 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:12.768817 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:12.988590 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:13.001788 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:13.003660 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:13.004487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-181f8978-146f-4303-a06c-8b02c381b994 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1719 microversion: 2.20 time: 0.300594 Jun 30 13:15:13.005054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 436/869] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:12 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1719 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:14.027932 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:14.028504 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:14.039031 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:14.039735 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:14.042267 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:14.042931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:14.259791 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:14.269959 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-6b84bcc9-ea67-4a68-aa30-8eaaa3c9dca5 req-28d52aa1-b570-4412-bb3a-c4731b4dd1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9860955c-dc0e-4b24-b696-9de9453da561", "name": "network-vif-unplugged", "status": "completed", "tag": "4a99638e-5bc5-455f-b4cc-97801113ceea"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:14.271055 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:14.273404 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:14.274665 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-65790f4d-21c9-48af-a683-024546814c01 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1722 microversion: 2.20 time: 0.251245 Jun 30 13:15:14.275609 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 434/870] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:14 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:15:14.285161 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6b84bcc9-ea67-4a68-aa30-8eaaa3c9dca5 req-28d52aa1-b570-4412-bb3a-c4731b4dd1fb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:14.286794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-6b84bcc9-ea67-4a68-aa30-8eaaa3c9dca5 req-28d52aa1-b570-4412-bb3a-c4731b4dd1fb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:14.295231 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1014cf77-9528-43d9-8d0e-035ee4565cac tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eb036c2-a1e2-4608-b5cf-60ba41898464"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:14.296698 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1014cf77-9528-43d9-8d0e-035ee4565cac tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:14.302964 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.compute.server_external_events [req-6b84bcc9-ea67-4a68-aa30-8eaaa3c9dca5 req-28d52aa1-b570-4412-bb3a-c4731b4dd1fb service nova] Unable to find a host for instance 9860955c-dc0e-4b24-b696-9de9453da561. Dropping event network-vif-unplugged {{(pid=117825) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 13:15:14.303535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1014cf77-9528-43d9-8d0e-035ee4565cac tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:14.304103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-6b84bcc9-ea67-4a68-aa30-8eaaa3c9dca5 req-28d52aa1-b570-4412-bb3a-c4731b4dd1fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038494 Jun 30 13:15:14.304292 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1014cf77-9528-43d9-8d0e-035ee4565cac tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:14.305251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 437/871] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 30 13:15:14.305464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1014cf77-9528-43d9-8d0e-035ee4565cac tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:14.305898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1014cf77-9528-43d9-8d0e-035ee4565cac tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:14.687918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1014cf77-9528-43d9-8d0e-035ee4565cac tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.398037 Jun 30 13:15:14.688558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 435/872] 10.222.0.49 () {62 vars in 1363 bytes} [Thu Jun 30 13:15:14 2022] POST /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/os-volume_attachments => generated 188 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 13:15:14.824531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9cd6d489-7145-46d7-89a0-6cf928fc106a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:14.825439 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9cd6d489-7145-46d7-89a0-6cf928fc106a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:14.831720 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cd6d489-7145-46d7-89a0-6cf928fc106a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:14.832107 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cd6d489-7145-46d7-89a0-6cf928fc106a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:14.832789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cd6d489-7145-46d7-89a0-6cf928fc106a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:14.833379 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9cd6d489-7145-46d7-89a0-6cf928fc106a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:15.195312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9cd6d489-7145-46d7-89a0-6cf928fc106a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/os-volume_attachments/6eb036c2-a1e2-4608-b5cf-60ba41898464" status: 202 len: 0 microversion: 2.20 time: 0.374669 Jun 30 13:15:15.196364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 438/873] 10.222.0.49 () {60 vars in 1456 bytes} [Thu Jun 30 13:15:14 2022] DELETE /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/os-volume_attachments/6eb036c2-a1e2-4608-b5cf-60ba41898464 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:15:15.258007 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a560633c-bc90-4219-b148-7d772df6b224 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:15.258630 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a560633c-bc90-4219-b148-7d772df6b224 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:15.265720 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a560633c-bc90-4219-b148-7d772df6b224 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:15.266408 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a560633c-bc90-4219-b148-7d772df6b224 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:15.267179 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a560633c-bc90-4219-b148-7d772df6b224 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:15.267781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a560633c-bc90-4219-b148-7d772df6b224 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:15.380944 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a560633c-bc90-4219-b148-7d772df6b224 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "POST /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/action" status: 202 len: 0 microversion: 2.20 time: 0.127231 Jun 30 13:15:15.384526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 436/874] 10.222.0.49 () {62 vars in 1318 bytes} [Thu Jun 30 13:15:15 2022] POST /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:15:15.391494 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:15.392087 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:15.398993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:15.399497 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:15.400311 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:15.400736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:15.424455 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:15.527626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c3c70f08-7ea1-4a8c-aa24-3064477b34b7 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Action: 'create', calling method: .version_select at 0x7f4b9f6db1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2015083666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3aoBfC3hKF06IeFBNrBjKbT4DPilPZHOfk3OBk/vV0AH5lOYKNXrPYqIv7yeqKo4vDW5u6DVf1eVmsYrfvtV4AEIUVHsEBPu/dNlTJYL+KZGPjbyGoQfFkHvu8LGW7zg=="}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:15.554288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-c3c70f08-7ea1-4a8c-aa24-3064477b34b7 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Getting quotas for project 80ff68a0b07e43d4bdb9c32f7166c9a1. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:15:15.560278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-c3c70f08-7ea1-4a8c-aa24-3064477b34b7 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Getting quotas for user 1c4aa9e4d27c4c2ea4b49ab188f841da and project 80ff68a0b07e43d4bdb9c32f7166c9a1. Resources: {'key_pairs'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:15:15.563349 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:15.571629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:15.573174 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:15.574458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2f82a777-25c3-4a6c-a160-b1b7e3753e3a tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1670 microversion: 2.20 time: 0.186760 Jun 30 13:15:15.575257 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 437/875] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:15 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1670 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 13:15:15.607151 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c3c70f08-7ea1-4a8c-aa24-3064477b34b7 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.308234 Jun 30 13:15:15.608363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 439/876] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:15:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:15:16.593737 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:16.594976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:16.602008 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:16.602486 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:16.603246 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:16.603662 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:16.776364 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:16.785768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:16.787623 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:16.788973 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8c678cb7-e9be-41f2-a93e-08feb6b0c553 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1672 microversion: 2.20 time: 0.199730 Jun 30 13:15:16.789680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 438/877] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:16 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:17.808892 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:17.809570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:17.816242 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:17.816680 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:17.817436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:17.817860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:17.984782 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:17.999706 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:18.001538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:18.003312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1e19f777-0152-4ade-bfd0-d163091379ab tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.198852 Jun 30 13:15:18.017434 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 440/878] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:17 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:19.030779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:19.032170 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:19.058744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:19.059249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:19.065202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:19.065698 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:19.324881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:19.335270 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:19.337327 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:19.338848 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fa8d43ee-45b5-439c-b895-128e729b69db tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.319422 Jun 30 13:15:19.339744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 439/879] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:19 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:20.358142 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:20.359491 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:20.374241 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:20.374855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:20.376439 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:20.376878 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:20.559759 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:20.568780 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:20.570515 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:20.571674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9df2ece3-dfd6-48cb-8230-fca9ada1dc91 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.218341 Jun 30 13:15:20.572238 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 441/880] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:20 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:21.597995 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:21.598796 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:21.607994 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:21.608427 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:21.609208 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:21.609628 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:21.760120 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:21.774223 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:21.775757 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:21.777447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-dcff335b-a727-4d6f-b105-57066a010fd4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.185389 Jun 30 13:15:21.779281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 440/881] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:21 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:22.798561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:22.799251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:22.802242 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:22.808573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:22.809017 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:22.809795 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:22.810236 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:22.961022 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:22.970964 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:22.972600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:22.973778 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bda71607-6320-4afd-a59f-fc3e573e74ee tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.180518 Jun 30 13:15:22.974365 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 442/882] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:22 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:23.998639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:23.999435 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:24.002925 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=40 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:24.006695 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:24.007208 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:24.008069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:24.008574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:24.160509 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:24.171594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:24.173262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:24.174615 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f7e4a1e8-e633-4c9f-8f83-ff2cb4b05d24 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.183305 Jun 30 13:15:24.175577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 441/883] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:23 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:25.193444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:25.194059 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:25.201261 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:25.201676 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:25.202611 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:25.202996 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:25.349349 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:25.358260 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:25.360557 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:25.361893 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-57276e24-e28f-44f0-88b8-c2732b07a13b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.172469 Jun 30 13:15:25.362684 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 443/884] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:25 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:26.317406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c7c9c752-aee5-41f7-ac48-e7230e45c691 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:26.318038 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c7c9c752-aee5-41f7-ac48-e7230e45c691 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:26.325464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c9c752-aee5-41f7-ac48-e7230e45c691 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:26.325948 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c9c752-aee5-41f7-ac48-e7230e45c691 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:26.326747 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c9c752-aee5-41f7-ac48-e7230e45c691 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:26.327335 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c9c752-aee5-41f7-ac48-e7230e45c691 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:26.358369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c7c9c752-aee5-41f7-ac48-e7230e45c691 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/ips" status: 200 len: 145 microversion: 2.1 time: 0.045446 Jun 30 13:15:26.358958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 442/885] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:15:26 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:26.380036 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:26.380650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:26.382537 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:26.388668 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:26.389095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:26.389870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:26.390297 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:26.553704 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:26.578630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:26.581199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:26.583147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f1948f61-95b8-4bc0-b987-238e07e3a490 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.206558 Jun 30 13:15:26.583742 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 444/886] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:26 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:27.604307 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:27.604983 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:27.612980 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:27.613794 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:27.614733 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:27.614733 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:27.763557 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:27.763861 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-3ec918ea-6cf9-48b3-a31b-dc142b686072 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82118f9d-4334-49ea-9baa-3ef79b3fd5ed"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:27.765455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-3ec918ea-6cf9-48b3-a31b-dc142b686072 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:27.775506 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:27.777694 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:27.779180 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-48f968ed-7049-44cf-9df8-e508cc255b53 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.179001 Jun 30 13:15:27.780203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 443/887] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:27 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:27.791017 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ec918ea-6cf9-48b3-a31b-dc142b686072 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:27.791825 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ec918ea-6cf9-48b3-a31b-dc142b686072 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:27.792891 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ec918ea-6cf9-48b3-a31b-dc142b686072 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:27.793523 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-3ec918ea-6cf9-48b3-a31b-dc142b686072 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:28.798511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:28.799164 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:28.806216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:28.806700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:28.807494 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:28.807919 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:28.944338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:28.953151 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:28.954637 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:28.956375 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c1bb194e-2c85-476d-819b-427e9f4cb695 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.161920 Jun 30 13:15:28.967869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 444/888] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:28 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:29.977397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:29.978123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:29.985164 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:29.985853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:29.986655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:29.987070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:30.136970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:30.145070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:30.146849 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:30.148006 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d05aedfa-56d9-4b97-8dff-bea2234fc209 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.175461 Jun 30 13:15:30.148556 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 445/889] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:29 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:31.171080 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:31.171882 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:31.182173 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:31.182905 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:31.184085 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:31.184725 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:31.321369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:31.329410 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:31.330930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:31.332075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-36eaf680-9db7-4ff2-8b33-e93a1aefa706 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.167923 Jun 30 13:15:31.332624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 446/890] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:31 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:32.351004 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:32.351766 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:32.358479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:32.359069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:32.359787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:32.360083 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:32.502295 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:32.515918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:32.517817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:32.519700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9ab060fa-d6ea-4468-a3d8-b439e0fca552 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.172543 Jun 30 13:15:32.520602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 447/891] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:32 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:33.540738 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:33.541395 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:33.548327 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:33.548762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:33.549510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:33.549927 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:33.708989 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:33.722638 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:33.724890 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:33.726676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f38a9850-9092-4e51-a738-f6f8e0a4be65 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.190457 Jun 30 13:15:33.727264 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 448/892] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:33 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:34.748555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:34.749366 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:34.759696 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:34.760271 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:34.761415 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:34.761916 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:34.900351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:34.909438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:34.910951 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:34.912094 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4c8db56f-2882-4f72-b149-f3f60d63cd77 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.170227 Jun 30 13:15:34.912655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 449/893] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:34 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:35.934519 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:35.935636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:35.946096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:35.946571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:35.947319 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:35.947738 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:36.096570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:36.108889 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:36.111194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:36.112955 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-48f85203-37c3-46ee-ba57-92e4c9a620cb tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.184999 Jun 30 13:15:36.113713 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 450/894] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:35 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:37.135231 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:37.135923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:37.142798 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:37.143232 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:37.143981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:37.144398 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:37.283055 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:37.292195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:37.293700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:37.294930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5014650b-a72d-46e1-9a8a-ca79ac39e9b8 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.164719 Jun 30 13:15:37.295494 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 451/895] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:37 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:37.771338 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=7 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:37.885772 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:38.318923 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:38.319532 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:38.328545 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:38.329088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:38.330177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:38.330787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:38.472583 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:38.480774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:38.482268 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:38.483460 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ecd47e16-70c4-40d1-b933-75c90d0dd92e tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.173146 Jun 30 13:15:38.484028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 452/896] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:38 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:39.506039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:39.507187 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:39.514700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:39.515065 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:39.515813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:39.516235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:39.658939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:39.669357 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:39.670910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:39.672075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bd4fbe6f-e02b-46ce-9020-70634b1493d0 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.172590 Jun 30 13:15:39.672627 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 453/897] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:39 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:40.694181 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:40.695296 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:40.706216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:40.707017 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:40.708258 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:40.708970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:40.730088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:40.855633 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:40.866475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:40.868663 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:40.870404 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bd8053ce-b39e-46d0-a14b-29c25c398c31 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.182659 Jun 30 13:15:40.871143 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 454/898] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:40 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:41.634337 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-3ec918ea-6cf9-48b3-a31b-dc142b686072 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.875173 Jun 30 13:15:41.635446 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 445/899] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:15:27 2022] POST /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments => generated 194 bytes in 13878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:41.893397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:41.894701 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:41.900993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:41.901451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:41.902203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:41.902655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:42.039767 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:42.048609 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:42.050156 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:42.051348 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-41a7d2fc-8db5-4723-83b2-663858291f0b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.162082 Jun 30 13:15:42.051941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 455/900] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:41 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:43.065564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-318483845", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2015083666", "security_groups": [{"name": "tempest-secgroup-smoke-590072109"}], "block_device_mapping_v2": [{"uuid": "7d1f3d74-4e01-4dc9-b278-adbb48913c96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c0d94028-8912-4867-bb69-bc96650821f0"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:43.070057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:43.070692 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:43.077515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:43.077955 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:43.078730 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:43.079138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:43.184401 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] validate_networks() for [('c0d94028-8912-4867-bb69-bc96650821f0', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:15:43.314594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:43.323135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:43.324745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:43.325986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-13d5cbc8-ae0e-4edc-8a49-cad92c482e93 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.259900 Jun 30 13:15:43.326621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 456/901] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:43 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:43.552626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:15:43.553229 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:15:43.553942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:15:43.554626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:15:43.555237 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:15:43.564976 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:43.565411 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:43.566191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:43.566644 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:43.583713 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Getting quotas for project 80ff68a0b07e43d4bdb9c32f7166c9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:15:43.588242 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Getting quotas for user 1c4aa9e4d27c4c2ea4b49ab188f841da and project 80ff68a0b07e43d4bdb9c32f7166c9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:15:43.761288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:15:43.763700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d1f3d74-4e01-4dc9-b278-adbb48913c96',volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:15:43.895095 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f6c8a016-89d8-4147-afb5-35c861ddfd34 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.833751 Jun 30 13:15:43.895776 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 446/902] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:15:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:15:43.906017 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-07527499-3313-4686-a6be-964c3a4cacc6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:43.906753 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-07527499-3313-4686-a6be-964c3a4cacc6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:43.959703 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-07527499-3313-4686-a6be-964c3a4cacc6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:43.966437 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-07527499-3313-4686-a6be-964c3a4cacc6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1094 microversion: 2.1 time: 0.064249 Jun 30 13:15:43.967216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 457/903] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:43 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:44.209117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-e6355d0f-4236-4c63-aadd-4349a0d705a9 req-f1eb94a4-6d77-4fb8-af72-8084fcdfd77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9860955c-dc0e-4b24-b696-9de9453da561", "name": "network-vif-plugged", "status": "completed", "tag": "4a99638e-5bc5-455f-b4cc-97801113ceea"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:44.220264 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e6355d0f-4236-4c63-aadd-4349a0d705a9 req-f1eb94a4-6d77-4fb8-af72-8084fcdfd77b service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:44.221143 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e6355d0f-4236-4c63-aadd-4349a0d705a9 req-f1eb94a4-6d77-4fb8-af72-8084fcdfd77b service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:44.233409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-e6355d0f-4236-4c63-aadd-4349a0d705a9 req-f1eb94a4-6d77-4fb8-af72-8084fcdfd77b service nova] Creating event network-vif-plugged:4a99638e-5bc5-455f-b4cc-97801113ceea for instance 9860955c-dc0e-4b24-b696-9de9453da561 on hv-cinder-81268 Jun 30 13:15:44.238957 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-e6355d0f-4236-4c63-aadd-4349a0d705a9 req-f1eb94a4-6d77-4fb8-af72-8084fcdfd77b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033901 Jun 30 13:15:44.240074 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 447/904] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:44.343893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:44.344479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:44.351644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:44.352497 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:44.353395 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:44.353821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:44.491460 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:44.500427 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:44.502192 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:44.503387 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-35e6383d-9cc0-41fa-89be-faf476867d4b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.163801 Jun 30 13:15:44.506477 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 458/905] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:44 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:44.989030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8e284e69-c055-47fc-be61-3317565f4ff1 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:44.990173 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8e284e69-c055-47fc-be61-3317565f4ff1 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:44.998024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e284e69-c055-47fc-be61-3317565f4ff1 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:44.998500 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e284e69-c055-47fc-be61-3317565f4ff1 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:44.999257 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e284e69-c055-47fc-be61-3317565f4ff1 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:44.999685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e284e69-c055-47fc-be61-3317565f4ff1 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:45.061496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8e284e69-c055-47fc-be61-3317565f4ff1 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:45.069645 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8e284e69-c055-47fc-be61-3317565f4ff1 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1192 microversion: 2.1 time: 0.087655 Jun 30 13:15:45.070143 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 448/906] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:44 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:45.526359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:45.527336 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:45.538364 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:45.539095 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:45.540289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:45.540708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:45.684667 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:45.693116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:45.694633 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:45.695811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-baeb14a1-5710-4ff9-8d4e-fac32c523ca1 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.176226 Jun 30 13:15:45.696406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 459/907] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:45 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:46.087706 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e5e3b766-03d9-40b7-9de3-8ffc4feba3d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:46.088385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e5e3b766-03d9-40b7-9de3-8ffc4feba3d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:46.095761 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e3b766-03d9-40b7-9de3-8ffc4feba3d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:46.096198 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e3b766-03d9-40b7-9de3-8ffc4feba3d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:46.096961 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e3b766-03d9-40b7-9de3-8ffc4feba3d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:46.097381 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e5e3b766-03d9-40b7-9de3-8ffc4feba3d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:46.167988 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e5e3b766-03d9-40b7-9de3-8ffc4feba3d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:46.176818 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e5e3b766-03d9-40b7-9de3-8ffc4feba3d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1210 microversion: 2.1 time: 0.093110 Jun 30 13:15:46.177399 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 449/908] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:46 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:46.713650 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:46.714213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:46.722876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:46.723315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:46.724467 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:46.724906 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:46.904485 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:46.912962 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:46.914643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:46.916377 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bd88eb40-fdf3-48ea-8cad-583fddd9e11c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1728 microversion: 2.20 time: 0.206737 Jun 30 13:15:46.916931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 460/909] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:46 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:47.194410 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0921fe2b-cc27-4e91-b89d-f391ca95708e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:47.195137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0921fe2b-cc27-4e91-b89d-f391ca95708e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:47.201955 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0921fe2b-cc27-4e91-b89d-f391ca95708e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:47.202417 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0921fe2b-cc27-4e91-b89d-f391ca95708e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:47.203178 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0921fe2b-cc27-4e91-b89d-f391ca95708e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:47.203598 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0921fe2b-cc27-4e91-b89d-f391ca95708e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:47.416524 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-52176ea5-a0ea-463e-893b-52e1c0931967 req-cf09f787-2f2d-4b6d-b909-ab4c5e298dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5339395e-cb3b-47b8-a0c6-a695a9909c35", "tag": "aa66d3a4-6b5c-49bd-ab08-db82f057af26"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:47.426213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-52176ea5-a0ea-463e-893b-52e1c0931967 req-cf09f787-2f2d-4b6d-b909-ab4c5e298dab service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:47.427042 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-52176ea5-a0ea-463e-893b-52e1c0931967 req-cf09f787-2f2d-4b6d-b909-ab4c5e298dab service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:47.439225 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-52176ea5-a0ea-463e-893b-52e1c0931967 req-cf09f787-2f2d-4b6d-b909-ab4c5e298dab service nova] Creating event network-changed:aa66d3a4-6b5c-49bd-ab08-db82f057af26 for instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 on hv-cinder-81268 Jun 30 13:15:47.445296 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0921fe2b-cc27-4e91-b89d-f391ca95708e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:47.445487 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-52176ea5-a0ea-463e-893b-52e1c0931967 req-cf09f787-2f2d-4b6d-b909-ab4c5e298dab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034519 Jun 30 13:15:47.445911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 461/910] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:47.462204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0921fe2b-cc27-4e91-b89d-f391ca95708e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1277 microversion: 2.1 time: 0.271493 Jun 30 13:15:47.462830 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 450/911] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:47 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:15:47.940111 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:47.941069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:47.949816 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:47.950257 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:47.951051 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:47.951477 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:48.085217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:48.094818 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:48.096750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:48.097922 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-85c27032-7f4f-4e12-a745-03f9b3604432 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1715 microversion: 2.20 time: 0.165257 Jun 30 13:15:48.098465 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 462/912] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:15:47 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:15:48.482180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16927350-b43a-4e8d-94a9-4af3b6459489 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:48.483008 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16927350-b43a-4e8d-94a9-4af3b6459489 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:48.495419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16927350-b43a-4e8d-94a9-4af3b6459489 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:48.496206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16927350-b43a-4e8d-94a9-4af3b6459489 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:48.497726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16927350-b43a-4e8d-94a9-4af3b6459489 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:48.498639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16927350-b43a-4e8d-94a9-4af3b6459489 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:48.710210 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16927350-b43a-4e8d-94a9-4af3b6459489 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:48.719608 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16927350-b43a-4e8d-94a9-4af3b6459489 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1277 microversion: 2.1 time: 0.242815 Jun 30 13:15:48.720772 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 451/913] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:48 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:49.154771 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-37051bf8-2624-416e-bdbf-1319a727bdd4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:49.156244 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-37051bf8-2624-416e-bdbf-1319a727bdd4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:49.164580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-37051bf8-2624-416e-bdbf-1319a727bdd4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:49.165451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-37051bf8-2624-416e-bdbf-1319a727bdd4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:49.166225 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-37051bf8-2624-416e-bdbf-1319a727bdd4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:49.166876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-37051bf8-2624-416e-bdbf-1319a727bdd4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:49.198167 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-37051bf8-2624-416e-bdbf-1319a727bdd4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048947 Jun 30 13:15:49.198761 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 463/914] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:15:49 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:49.211277 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-871a6fda-55af-416e-a33e-06c9381106ee tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:49.211812 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-871a6fda-55af-416e-a33e-06c9381106ee tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:49.217879 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-871a6fda-55af-416e-a33e-06c9381106ee tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:49.218396 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-871a6fda-55af-416e-a33e-06c9381106ee tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:49.219083 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-871a6fda-55af-416e-a33e-06c9381106ee tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:49.219513 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-871a6fda-55af-416e-a33e-06c9381106ee tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:49.253601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-871a6fda-55af-416e-a33e-06c9381106ee tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/82118f9d-4334-49ea-9baa-3ef79b3fd5ed" status: 200 len: 194 microversion: 2.1 time: 0.046396 Jun 30 13:15:49.254191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 452/915] 10.222.0.49 () {58 vars in 1412 bytes} [Thu Jun 30 13:15:49 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/82118f9d-4334-49ea-9baa-3ef79b3fd5ed => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:49.741554 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0eefeacb-b4a8-4860-9b5b-794bed8aca4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:49.742588 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0eefeacb-b4a8-4860-9b5b-794bed8aca4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:49.749508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0eefeacb-b4a8-4860-9b5b-794bed8aca4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:49.749949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0eefeacb-b4a8-4860-9b5b-794bed8aca4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:49.750757 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0eefeacb-b4a8-4860-9b5b-794bed8aca4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:49.751184 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0eefeacb-b4a8-4860-9b5b-794bed8aca4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:49.895016 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0eefeacb-b4a8-4860-9b5b-794bed8aca4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:49.906196 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0eefeacb-b4a8-4860-9b5b-794bed8aca4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.171066 Jun 30 13:15:49.906876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 464/916] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:49 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:50.594132 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8e868ebd-8502-48ff-bd7d-586468160317 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb1404c0-4e06-4b6d-8d3a-8929efd80ef2"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:15:50.595617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8e868ebd-8502-48ff-bd7d-586468160317 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:50.602279 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e868ebd-8502-48ff-bd7d-586468160317 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:50.602757 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e868ebd-8502-48ff-bd7d-586468160317 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:50.603697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e868ebd-8502-48ff-bd7d-586468160317 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:50.604211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8e868ebd-8502-48ff-bd7d-586468160317 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:50.883589 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8e868ebd-8502-48ff-bd7d-586468160317 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "POST /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293325 Jun 30 13:15:50.884396 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 453/917] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:15:50 2022] POST /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:50.929203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-771b379d-b19f-4420-803f-d7534d5d9548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:50.929847 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-771b379d-b19f-4420-803f-d7534d5d9548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:50.940311 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-771b379d-b19f-4420-803f-d7534d5d9548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:50.940751 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-771b379d-b19f-4420-803f-d7534d5d9548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:50.941552 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-771b379d-b19f-4420-803f-d7534d5d9548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:50.941975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-771b379d-b19f-4420-803f-d7534d5d9548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:51.077901 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-771b379d-b19f-4420-803f-d7534d5d9548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:51.085457 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-771b379d-b19f-4420-803f-d7534d5d9548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.162410 Jun 30 13:15:51.086026 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 465/918] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:50 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:52.107531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-989d4b11-ed1c-4d2b-a3f4-f6a7bc1c46dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:52.108251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-989d4b11-ed1c-4d2b-a3f4-f6a7bc1c46dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:52.115709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-989d4b11-ed1c-4d2b-a3f4-f6a7bc1c46dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:52.116262 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-989d4b11-ed1c-4d2b-a3f4-f6a7bc1c46dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:52.117172 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-989d4b11-ed1c-4d2b-a3f4-f6a7bc1c46dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:52.117657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-989d4b11-ed1c-4d2b-a3f4-f6a7bc1c46dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:52.256002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-989d4b11-ed1c-4d2b-a3f4-f6a7bc1c46dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:52.263974 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-989d4b11-ed1c-4d2b-a3f4-f6a7bc1c46dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.162840 Jun 30 13:15:52.264537 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 454/919] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:52 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:53.283811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f128e372-c24a-470d-8a8e-1e73cdd28753 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:53.284452 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f128e372-c24a-470d-8a8e-1e73cdd28753 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:53.291138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f128e372-c24a-470d-8a8e-1e73cdd28753 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:53.291567 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f128e372-c24a-470d-8a8e-1e73cdd28753 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:53.292333 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f128e372-c24a-470d-8a8e-1e73cdd28753 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:53.292765 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f128e372-c24a-470d-8a8e-1e73cdd28753 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:53.428737 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f128e372-c24a-470d-8a8e-1e73cdd28753 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:53.436880 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f128e372-c24a-470d-8a8e-1e73cdd28753 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.158422 Jun 30 13:15:53.437422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 466/920] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:53 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:54.455944 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-378faf90-f2c5-4905-b208-be08aef53c09 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:54.456570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-378faf90-f2c5-4905-b208-be08aef53c09 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:54.459124 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:54.459806 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:54.467120 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-378faf90-f2c5-4905-b208-be08aef53c09 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:54.467602 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-378faf90-f2c5-4905-b208-be08aef53c09 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:54.468397 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-378faf90-f2c5-4905-b208-be08aef53c09 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:54.468838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-378faf90-f2c5-4905-b208-be08aef53c09 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:54.603534 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-378faf90-f2c5-4905-b208-be08aef53c09 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:54.616078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-378faf90-f2c5-4905-b208-be08aef53c09 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.164021 Jun 30 13:15:54.617005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 455/921] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:54 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:55.640426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-06733a2f-3034-4f59-a78f-e06934c9fe0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:55.641433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-06733a2f-3034-4f59-a78f-e06934c9fe0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:55.644574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:55.646503 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=54 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:55.655964 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06733a2f-3034-4f59-a78f-e06934c9fe0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:55.656406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06733a2f-3034-4f59-a78f-e06934c9fe0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:55.657170 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06733a2f-3034-4f59-a78f-e06934c9fe0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:55.657599 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-06733a2f-3034-4f59-a78f-e06934c9fe0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:55.812707 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-06733a2f-3034-4f59-a78f-e06934c9fe0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:55.820446 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-06733a2f-3034-4f59-a78f-e06934c9fe0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.187231 Jun 30 13:15:55.820982 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 467/922] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:55 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:56.837321 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6ef0af8c-0a6e-4591-a526-64ea634c9d4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:56.837885 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6ef0af8c-0a6e-4591-a526-64ea634c9d4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:56.844979 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0af8c-0a6e-4591-a526-64ea634c9d4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:56.845792 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0af8c-0a6e-4591-a526-64ea634c9d4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:56.846549 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0af8c-0a6e-4591-a526-64ea634c9d4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:56.847007 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6ef0af8c-0a6e-4591-a526-64ea634c9d4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:56.992526 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6ef0af8c-0a6e-4591-a526-64ea634c9d4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:57.000760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6ef0af8c-0a6e-4591-a526-64ea634c9d4a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.167414 Jun 30 13:15:57.001337 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 456/923] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:56 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:58.021755 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4607502b-e390-480b-8e91-7b3d9f235bf3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:58.022840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4607502b-e390-480b-8e91-7b3d9f235bf3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:58.034568 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4607502b-e390-480b-8e91-7b3d9f235bf3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:58.035346 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4607502b-e390-480b-8e91-7b3d9f235bf3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:58.036693 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4607502b-e390-480b-8e91-7b3d9f235bf3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:58.037412 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4607502b-e390-480b-8e91-7b3d9f235bf3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:58.193556 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4607502b-e390-480b-8e91-7b3d9f235bf3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:58.201948 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4607502b-e390-480b-8e91-7b3d9f235bf3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.186149 Jun 30 13:15:58.203215 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 468/924] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:58 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:15:58.465213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9c3626bc-9484-4f00-b5a6-92893b827ac8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:58.466262 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9c3626bc-9484-4f00-b5a6-92893b827ac8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:58.473870 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c3626bc-9484-4f00-b5a6-92893b827ac8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:58.474437 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c3626bc-9484-4f00-b5a6-92893b827ac8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:58.475286 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c3626bc-9484-4f00-b5a6-92893b827ac8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:58.475791 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9c3626bc-9484-4f00-b5a6-92893b827ac8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:58.507672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9c3626bc-9484-4f00-b5a6-92893b827ac8 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046714 Jun 30 13:15:58.508352 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 457/925] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:15:58 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:58.657595 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4153b094-2da1-4642-828a-c3dcfa2e4af9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:58.658240 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4153b094-2da1-4642-828a-c3dcfa2e4af9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:58.665026 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4153b094-2da1-4642-828a-c3dcfa2e4af9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:58.665464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4153b094-2da1-4642-828a-c3dcfa2e4af9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:58.666215 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4153b094-2da1-4642-828a-c3dcfa2e4af9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:58.666710 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4153b094-2da1-4642-828a-c3dcfa2e4af9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:58.697823 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4153b094-2da1-4642-828a-c3dcfa2e4af9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/82118f9d-4334-49ea-9baa-3ef79b3fd5ed" status: 200 len: 194 microversion: 2.1 time: 0.044410 Jun 30 13:15:58.698432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 469/926] 10.222.0.49 () {58 vars in 1412 bytes} [Thu Jun 30 13:15:58 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/82118f9d-4334-49ea-9baa-3ef79b3fd5ed => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:15:58.708551 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-824a60b1-e6de-49ac-844b-7ca06dea9c59 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:58.709038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-824a60b1-e6de-49ac-844b-7ca06dea9c59 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:58.715055 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-824a60b1-e6de-49ac-844b-7ca06dea9c59 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:58.715594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-824a60b1-e6de-49ac-844b-7ca06dea9c59 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:58.716349 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-824a60b1-e6de-49ac-844b-7ca06dea9c59 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:58.716921 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-824a60b1-e6de-49ac-844b-7ca06dea9c59 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:58.799493 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-824a60b1-e6de-49ac-844b-7ca06dea9c59 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lazy-loading 'services' on Instance uuid 3b755558-bb4a-4894-bb35-0da6a41544ca {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:15:58.877303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-824a60b1-e6de-49ac-844b-7ca06dea9c59 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/82118f9d-4334-49ea-9baa-3ef79b3fd5ed" status: 202 len: 0 microversion: 2.1 time: 0.172577 Jun 30 13:15:58.878088 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 458/927] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:15:58 2022] DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/82118f9d-4334-49ea-9baa-3ef79b3fd5ed => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:15:59.220607 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-840e083a-3f41-4bf2-b5a2-65d3c2ce27dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:15:59.221245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-840e083a-3f41-4bf2-b5a2-65d3c2ce27dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:15:59.228128 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-840e083a-3f41-4bf2-b5a2-65d3c2ce27dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:59.228593 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-840e083a-3f41-4bf2-b5a2-65d3c2ce27dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:59.229316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-840e083a-3f41-4bf2-b5a2-65d3c2ce27dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:15:59.229736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-840e083a-3f41-4bf2-b5a2-65d3c2ce27dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:15:59.367915 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-840e083a-3f41-4bf2-b5a2-65d3c2ce27dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:15:59.375658 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-840e083a-3f41-4bf2-b5a2-65d3c2ce27dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.159507 Jun 30 13:15:59.376147 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 470/928] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:15:59 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:00.340567 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-d7bb5edb-bacd-49ab-aa18-436fd01a749b req-133efeb0-e90c-403d-bd22-01051d4f47b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5339395e-cb3b-47b8-a0c6-a695a9909c35", "name": "network-vif-plugged", "status": "completed", "tag": "aa66d3a4-6b5c-49bd-ab08-db82f057af26"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:16:00.351973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d7bb5edb-bacd-49ab-aa18-436fd01a749b req-133efeb0-e90c-403d-bd22-01051d4f47b7 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:00.352361 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-d7bb5edb-bacd-49ab-aa18-436fd01a749b req-133efeb0-e90c-403d-bd22-01051d4f47b7 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:00.364194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-d7bb5edb-bacd-49ab-aa18-436fd01a749b req-133efeb0-e90c-403d-bd22-01051d4f47b7 service nova] Creating event network-vif-plugged:aa66d3a4-6b5c-49bd-ab08-db82f057af26 for instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 on hv-cinder-81268 Jun 30 13:16:00.368855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-d7bb5edb-bacd-49ab-aa18-436fd01a749b req-133efeb0-e90c-403d-bd22-01051d4f47b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032881 Jun 30 13:16:00.369809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 459/929] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:00.393045 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c3b5bd7e-8a34-4b00-97c7-e68a85c2f5dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:00.393619 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c3b5bd7e-8a34-4b00-97c7-e68a85c2f5dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:00.400505 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c3b5bd7e-8a34-4b00-97c7-e68a85c2f5dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:00.400772 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c3b5bd7e-8a34-4b00-97c7-e68a85c2f5dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:00.401533 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c3b5bd7e-8a34-4b00-97c7-e68a85c2f5dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:00.401958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c3b5bd7e-8a34-4b00-97c7-e68a85c2f5dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:00.540608 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c3b5bd7e-8a34-4b00-97c7-e68a85c2f5dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:00.548767 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c3b5bd7e-8a34-4b00-97c7-e68a85c2f5dc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.159967 Jun 30 13:16:00.549380 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 471/930] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:00 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:01.063574 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2d097982-fac7-44e4-b55c-1eada1e3e099 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:01.064152 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2d097982-fac7-44e4-b55c-1eada1e3e099 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:01.070681 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d097982-fac7-44e4-b55c-1eada1e3e099 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:01.071124 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d097982-fac7-44e4-b55c-1eada1e3e099 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:01.071888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d097982-fac7-44e4-b55c-1eada1e3e099 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:01.072318 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2d097982-fac7-44e4-b55c-1eada1e3e099 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:01.102519 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2d097982-fac7-44e4-b55c-1eada1e3e099 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/eb1404c0-4e06-4b6d-8d3a-8929efd80ef2" status: 200 len: 194 microversion: 2.1 time: 0.043078 Jun 30 13:16:01.103144 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 460/931] 10.222.0.49 () {58 vars in 1412 bytes} [Thu Jun 30 13:16:01 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/eb1404c0-4e06-4b6d-8d3a-8929efd80ef2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:01.113774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-be6f69d1-d572-4840-9b21-f3672a78fa44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:01.114261 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-be6f69d1-d572-4840-9b21-f3672a78fa44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:01.121485 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-be6f69d1-d572-4840-9b21-f3672a78fa44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:01.121931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-be6f69d1-d572-4840-9b21-f3672a78fa44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:01.122718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-be6f69d1-d572-4840-9b21-f3672a78fa44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:01.123146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-be6f69d1-d572-4840-9b21-f3672a78fa44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:01.202347 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=100 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:01.206182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-be6f69d1-d572-4840-9b21-f3672a78fa44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lazy-loading 'services' on Instance uuid 3b755558-bb4a-4894-bb35-0da6a41544ca {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:16:01.280105 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-be6f69d1-d572-4840-9b21-f3672a78fa44 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/eb1404c0-4e06-4b6d-8d3a-8929efd80ef2" status: 202 len: 0 microversion: 2.1 time: 0.170223 Jun 30 13:16:01.281089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 472/932] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:16:01 2022] DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments/eb1404c0-4e06-4b6d-8d3a-8929efd80ef2 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:16:01.565515 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c0a12e1-9165-4940-a42f-cf44f8316f48 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:01.566074 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c0a12e1-9165-4940-a42f-cf44f8316f48 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:01.573029 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c0a12e1-9165-4940-a42f-cf44f8316f48 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:01.573465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c0a12e1-9165-4940-a42f-cf44f8316f48 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:01.574225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c0a12e1-9165-4940-a42f-cf44f8316f48 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:01.574697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c0a12e1-9165-4940-a42f-cf44f8316f48 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:01.578804 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:01.710953 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6c0a12e1-9165-4940-a42f-cf44f8316f48 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:01.718925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c0a12e1-9165-4940-a42f-cf44f8316f48 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1265 microversion: 2.1 time: 0.157435 Jun 30 13:16:01.719522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 461/933] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:01 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:02.742724 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-772df193-c552-4392-9335-d3c5a012be80 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:02.743602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-772df193-c552-4392-9335-d3c5a012be80 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:02.752877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-772df193-c552-4392-9335-d3c5a012be80 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:02.753456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-772df193-c552-4392-9335-d3c5a012be80 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:02.754502 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-772df193-c552-4392-9335-d3c5a012be80 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:02.755064 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-772df193-c552-4392-9335-d3c5a012be80 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:02.897283 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-772df193-c552-4392-9335-d3c5a012be80 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:02.905694 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-772df193-c552-4392-9335-d3c5a012be80 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1451 microversion: 2.1 time: 0.171191 Jun 30 13:16:02.906257 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 473/934] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:02 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:02.922160 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-626288ff-81c9-4d66-ba63-45c128c47b0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:02.922844 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-626288ff-81c9-4d66-ba63-45c128c47b0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:02.929442 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-626288ff-81c9-4d66-ba63-45c128c47b0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:02.929880 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-626288ff-81c9-4d66-ba63-45c128c47b0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:02.930661 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-626288ff-81c9-4d66-ba63-45c128c47b0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:02.931085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-626288ff-81c9-4d66-ba63-45c128c47b0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:03.068493 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-626288ff-81c9-4d66-ba63-45c128c47b0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:03.076690 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-626288ff-81c9-4d66-ba63-45c128c47b0f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1451 microversion: 2.1 time: 0.158611 Jun 30 13:16:03.077587 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 462/935] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:02 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:03.502201 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7626f51d-8378-4f52-992c-9d7da33a76d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:03.503369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7626f51d-8378-4f52-992c-9d7da33a76d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:03.509720 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7626f51d-8378-4f52-992c-9d7da33a76d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:03.510270 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7626f51d-8378-4f52-992c-9d7da33a76d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:03.511122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7626f51d-8378-4f52-992c-9d7da33a76d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:03.511559 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7626f51d-8378-4f52-992c-9d7da33a76d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:03.542354 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7626f51d-8378-4f52-992c-9d7da33a76d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044244 Jun 30 13:16:03.542937 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 474/936] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:16:03 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:16:03.649942 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-82261c05-1195-4576-95b1-d49c55ed78d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:03.650837 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-82261c05-1195-4576-95b1-d49c55ed78d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:03.657252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82261c05-1195-4576-95b1-d49c55ed78d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:03.657686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82261c05-1195-4576-95b1-d49c55ed78d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:03.658998 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82261c05-1195-4576-95b1-d49c55ed78d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:03.658998 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-82261c05-1195-4576-95b1-d49c55ed78d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:03.689841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-82261c05-1195-4576-95b1-d49c55ed78d9 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043921 Jun 30 13:16:03.690737 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 463/937] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:16:03 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:16:03.750855 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4463281b-91dd-4a7b-a889-6255be920e38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:03.751432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4463281b-91dd-4a7b-a889-6255be920e38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:03.757922 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4463281b-91dd-4a7b-a889-6255be920e38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:03.758457 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4463281b-91dd-4a7b-a889-6255be920e38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:03.759277 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4463281b-91dd-4a7b-a889-6255be920e38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:03.759697 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4463281b-91dd-4a7b-a889-6255be920e38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:03.786927 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4463281b-91dd-4a7b-a889-6255be920e38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:16:03.871361 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4463281b-91dd-4a7b-a889-6255be920e38 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 204 len: 0 microversion: 2.1 time: 0.124155 Jun 30 13:16:03.872335 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 475/938] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:16:03 2022] DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:16:03.880729 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f0f8c01f-b14b-42f7-8879-04843ce8ddf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:03.881424 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f0f8c01f-b14b-42f7-8879-04843ce8ddf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:03.887370 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0f8c01f-b14b-42f7-8879-04843ce8ddf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:03.887807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0f8c01f-b14b-42f7-8879-04843ce8ddf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:03.888554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0f8c01f-b14b-42f7-8879-04843ce8ddf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:03.888974 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0f8c01f-b14b-42f7-8879-04843ce8ddf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:04.026872 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f0f8c01f-b14b-42f7-8879-04843ce8ddf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:04.034496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f0f8c01f-b14b-42f7-8879-04843ce8ddf0 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1672 microversion: 2.1 time: 0.157812 Jun 30 13:16:04.035027 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 464/939] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:03 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:04.769255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-d80254c6-8712-4b9a-9590-4eb1f63be56e req-f0363a51-0749-4b88-b00d-49ef7f2d22e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5339395e-cb3b-47b8-a0c6-a695a9909c35", "tag": "aa66d3a4-6b5c-49bd-ab08-db82f057af26"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:16:04.778129 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-d80254c6-8712-4b9a-9590-4eb1f63be56e req-f0363a51-0749-4b88-b00d-49ef7f2d22e0 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:04.778592 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-d80254c6-8712-4b9a-9590-4eb1f63be56e req-f0363a51-0749-4b88-b00d-49ef7f2d22e0 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:04.790600 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-d80254c6-8712-4b9a-9590-4eb1f63be56e req-f0363a51-0749-4b88-b00d-49ef7f2d22e0 service nova] Creating event network-changed:aa66d3a4-6b5c-49bd-ab08-db82f057af26 for instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 on hv-cinder-81268 Jun 30 13:16:04.795586 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-d80254c6-8712-4b9a-9590-4eb1f63be56e req-f0363a51-0749-4b88-b00d-49ef7f2d22e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031197 Jun 30 13:16:04.796175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 476/940] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:05.052205 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-16869d1c-d99c-40d3-8b14-ac2c176eafc4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:05.052846 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-16869d1c-d99c-40d3-8b14-ac2c176eafc4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:05.059754 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16869d1c-d99c-40d3-8b14-ac2c176eafc4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:05.060202 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16869d1c-d99c-40d3-8b14-ac2c176eafc4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:05.060955 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16869d1c-d99c-40d3-8b14-ac2c176eafc4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:05.061515 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-16869d1c-d99c-40d3-8b14-ac2c176eafc4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:05.196160 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-16869d1c-d99c-40d3-8b14-ac2c176eafc4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:05.204268 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-16869d1c-d99c-40d3-8b14-ac2c176eafc4 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1672 microversion: 2.1 time: 0.156049 Jun 30 13:16:05.204866 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 465/941] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:05 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:06.222126 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-366b5587-2004-44c6-941c-78961afc3a06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:06.222842 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-366b5587-2004-44c6-941c-78961afc3a06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:06.229875 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-366b5587-2004-44c6-941c-78961afc3a06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:06.230315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-366b5587-2004-44c6-941c-78961afc3a06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:06.231129 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-366b5587-2004-44c6-941c-78961afc3a06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:06.231552 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-366b5587-2004-44c6-941c-78961afc3a06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:06.367532 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-366b5587-2004-44c6-941c-78961afc3a06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:06.375582 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-366b5587-2004-44c6-941c-78961afc3a06 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1672 microversion: 2.1 time: 0.158221 Jun 30 13:16:06.376192 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 477/942] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:06 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:07.173869 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-16c775ed-7ee5-4b4e-a3bd-4d194c1b8866 req-a3c4f44b-5b63-4efe-9ca8-2117cd813fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b755558-bb4a-4894-bb35-0da6a41544ca", "name": "network-vif-deleted", "tag": "88658676-64f1-4a38-b5b9-ee5a9a4c65c2"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:16:07.183181 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-16c775ed-7ee5-4b4e-a3bd-4d194c1b8866 req-a3c4f44b-5b63-4efe-9ca8-2117cd813fea service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:07.183560 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-16c775ed-7ee5-4b4e-a3bd-4d194c1b8866 req-a3c4f44b-5b63-4efe-9ca8-2117cd813fea service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:07.196087 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-16c775ed-7ee5-4b4e-a3bd-4d194c1b8866 req-a3c4f44b-5b63-4efe-9ca8-2117cd813fea service nova] Creating event network-vif-deleted:88658676-64f1-4a38-b5b9-ee5a9a4c65c2 for instance 3b755558-bb4a-4894-bb35-0da6a41544ca on hv-cinder-81268 Jun 30 13:16:07.201521 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-16c775ed-7ee5-4b4e-a3bd-4d194c1b8866 req-a3c4f44b-5b63-4efe-9ca8-2117cd813fea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031323 Jun 30 13:16:07.205915 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 466/943] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:07.394956 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:07.395976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:07.404928 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:07.405777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:07.406584 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:07.407008 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:07.438207 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:07.438679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:07.439115 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lazy-loading 'fault' on Instance uuid 3b755558-bb4a-4894-bb35-0da6a41544ca {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:16:07.479837 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0df4b789a804a00a267bcc5cf778324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671e576de2c44e6b1f5df7c53aae76a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:07.487443 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6d5c6e3e-fc12-4d2f-9781-e28dc41b7cc7 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 200 len: 1326 microversion: 2.1 time: 0.097669 Jun 30 13:16:07.487979 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 478/944] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:07 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:08.509849 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:08.510752 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:08.513201 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:08.520586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:08.521024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:08.521790 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:08.522217 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:08.537737 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] HTTP exception thrown: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Request method failure captured: Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca HTTP/1.1 Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-2SOjfoQz0uAeE5VNJ8r17gmOfJQPMhA6ywZGx26FCBHzEe44jjfDb1y53FhcnNyxDOZxBzqjwdGhPfEfrD7LsU5O34l5tIvVBX5ttaUVBf3HzJA7K_OXD3MyxASuOySYnhyQFUtIA15wroph0co_tYMVJccM-P3P33Bpg3S_oN0U Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:16:08.539436 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}] Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: e0df4b789a804a00a267bcc5cf778324 Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:08.541085 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '3b755558-bb4a-4894-bb35-0da6a41544ca'} Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:08.541946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:08.543430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:08.544709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Returning 404 to user: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:08.544709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6f2ebcff-ebb5-40be-ad92-713eb64e2d13 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 404 len: 111 microversion: 2.1 time: 0.039026 Jun 30 13:16:08.544709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 467/945] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:08 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:08.550026 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-339ecfcf-7133-4148-b285-a11a9eb1a179 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '.version_select at 0x7f4ba407c790>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:08.569870 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-339ecfcf-7133-4148-b285-a11a9eb1a179 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639750864" status: 202 len: 0 microversion: 2.1 time: 0.023945 Jun 30 13:16:08.570462 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 479/946] 10.222.0.49 () {58 vars in 1217 bytes} [Thu Jun 30 13:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639750864 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 13:16:11.157798 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-65f705e4-c37b-47fc-afc8-a70efe8c66e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:11.158365 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-65f705e4-c37b-47fc-afc8-a70efe8c66e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:11.159829 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-aeee0b1d-f30a-44c6-b86d-9afc0802d03b req-2da8ea1d-e35e-4807-9f25-feec96deb743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6237f937-32a4-40da-aebc-6bc1311b08a4", "tag": "da28b1a6-cb2b-4c40-9af4-d3051711bd7c"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:16:11.165106 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65f705e4-c37b-47fc-afc8-a70efe8c66e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.165518 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65f705e4-c37b-47fc-afc8-a70efe8c66e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.166269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65f705e4-c37b-47fc-afc8-a70efe8c66e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.166716 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-65f705e4-c37b-47fc-afc8-a70efe8c66e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.172043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-aeee0b1d-f30a-44c6-b86d-9afc0802d03b req-2da8ea1d-e35e-4807-9f25-feec96deb743 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.172655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-aeee0b1d-f30a-44c6-b86d-9afc0802d03b req-2da8ea1d-e35e-4807-9f25-feec96deb743 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.183640 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-aeee0b1d-f30a-44c6-b86d-9afc0802d03b req-2da8ea1d-e35e-4807-9f25-feec96deb743 service nova] Creating event network-changed:da28b1a6-cb2b-4c40-9af4-d3051711bd7c for instance 6237f937-32a4-40da-aebc-6bc1311b08a4 on hv-cinder-81268 Jun 30 13:16:11.189124 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-aeee0b1d-f30a-44c6-b86d-9afc0802d03b req-2da8ea1d-e35e-4807-9f25-feec96deb743 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033824 Jun 30 13:16:11.190012 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 480/947] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:11.196431 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-65f705e4-c37b-47fc-afc8-a70efe8c66e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:16:11.294099 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-65f705e4-c37b-47fc-afc8-a70efe8c66e0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 204 len: 0 microversion: 2.1 time: 0.139562 Jun 30 13:16:11.295017 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 468/948] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:16:11 2022] DELETE /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:16:11.303966 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f836d9ce-70fb-4c4e-9ced-ede1d2ff3cc6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:11.304782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f836d9ce-70fb-4c4e-9ced-ede1d2ff3cc6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:11.311327 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f836d9ce-70fb-4c4e-9ced-ede1d2ff3cc6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.312018 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f836d9ce-70fb-4c4e-9ced-ede1d2ff3cc6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.312853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f836d9ce-70fb-4c4e-9ced-ede1d2ff3cc6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.313283 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f836d9ce-70fb-4c4e-9ced-ede1d2ff3cc6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.452593 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f836d9ce-70fb-4c4e-9ced-ede1d2ff3cc6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:11.460610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f836d9ce-70fb-4c4e-9ced-ede1d2ff3cc6 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.160983 Jun 30 13:16:11.461261 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 481/949] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:11 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:11.513699 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:11.514277 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:11.520875 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.521506 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.522513 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.522899 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.537490 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] HTTP exception thrown: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Request method failure captured: Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca HTTP/1.1 Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-2SOjfoQz0uAeE5VNJ8r17gmOfJQPMhA6ywZGx26FCBHzEe44jjfDb1y53FhcnNyxDOZxBzqjwdGhPfEfrD7LsU5O34l5tIvVBX5ttaUVBf3HzJA7K_OXD3MyxASuOySYnhyQFUtIA15wroph0co_tYMVJccM-P3P33Bpg3S_oN0U Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:16:11.539199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}] Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: e0df4b789a804a00a267bcc5cf778324 Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.540774 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '3b755558-bb4a-4894-bb35-0da6a41544ca'} Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:11.541578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.543019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.544455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Returning 404 to user: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:11.544455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50a677e1-2794-46c0-8f9e-167518620396 tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 404 len: 111 microversion: 2.1 time: 0.031224 Jun 30 13:16:11.544455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 469/950] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:16:11 2022] DELETE /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:11.549471 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:11.550078 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: 3b755558-bb4a-4894-bb35-0da6a41544ca] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:11.556155 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.556599 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.557347 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:11.557770 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:11.571174 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] HTTP exception thrown: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Request method failure captured: Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca HTTP/1.1 Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-2SOjfoQz0uAeE5VNJ8r17gmOfJQPMhA6ywZGx26FCBHzEe44jjfDb1y53FhcnNyxDOZxBzqjwdGhPfEfrD7LsU5O34l5tIvVBX5ttaUVBf3HzJA7K_OXD3MyxASuOySYnhyQFUtIA15wroph0co_tYMVJccM-P3P33Bpg3S_oN0U Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:16:11.572981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}] Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: e0df4b789a804a00a267bcc5cf778324 Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.574515 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '3b755558-bb4a-4894-bb35-0da6a41544ca'} Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:11.575393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. Jun 30 13:16:11.576680 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:11.577940 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Returning 404 to user: Instance 3b755558-bb4a-4894-bb35-0da6a41544ca could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:11.577940 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c2fe5ae4-39f0-4996-9c7c-19ef6f72d90f tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca" status: 404 len: 111 microversion: 2.1 time: 0.029050 Jun 30 13:16:11.577940 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 482/951] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:11 2022] GET /compute/v2.1/servers/3b755558-bb4a-4894-bb35-0da6a41544ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:12.482651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc9e91e5-2f5d-4acd-918c-9bd435cfbdad tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:12.483679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc9e91e5-2f5d-4acd-918c-9bd435cfbdad tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:12.495473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc9e91e5-2f5d-4acd-918c-9bd435cfbdad tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:12.496203 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc9e91e5-2f5d-4acd-918c-9bd435cfbdad tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:12.497422 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc9e91e5-2f5d-4acd-918c-9bd435cfbdad tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:12.498139 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc9e91e5-2f5d-4acd-918c-9bd435cfbdad tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:12.713580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:12.714094 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:12.721674 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:12.722119 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:12.722930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:12.723850 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:12.733215 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc9e91e5-2f5d-4acd-918c-9bd435cfbdad tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:12.738087 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] HTTP exception thrown: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Request method failure captured: Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 HTTP/1.1 Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-2SOjfoQz0uAeE5VNJ8r17gmOfJQPMhA6ywZGx26FCBHzEe44jjfDb1y53FhcnNyxDOZxBzqjwdGhPfEfrD7LsU5O34l5tIvVBX5ttaUVBf3HzJA7K_OXD3MyxASuOySYnhyQFUtIA15wroph0co_tYMVJccM-P3P33Bpg3S_oN0U Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:16:12.739708 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}] Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: e0df4b789a804a00a267bcc5cf778324 Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.741305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': 'bfaf5f03-a265-481f-81c5-2f4432079c41'} Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:12.742092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.743285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.744493 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Returning 404 to user: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:12.744493 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-91a21694-9ab0-4cf2-825b-b78435ff159b tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 404 len: 111 microversion: 2.1 time: 0.031481 Jun 30 13:16:12.744493 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 483/952] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:16:12 2022] DELETE /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:12.744863 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc9e91e5-2f5d-4acd-918c-9bd435cfbdad tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1567 microversion: 2.1 time: 0.267021 Jun 30 13:16:12.744863 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 470/953] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:12 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:12.751706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:12.752394 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] [instance: bfaf5f03-a265-481f-81c5-2f4432079c41] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:12.759047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:12.759488 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:12.760252 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:12.760679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:12.777195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] HTTP exception thrown: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Request method failure captured: Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 HTTP/1.1 Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-2SOjfoQz0uAeE5VNJ8r17gmOfJQPMhA6ywZGx26FCBHzEe44jjfDb1y53FhcnNyxDOZxBzqjwdGhPfEfrD7LsU5O34l5tIvVBX5ttaUVBf3HzJA7K_OXD3MyxASuOySYnhyQFUtIA15wroph0co_tYMVJccM-P3P33Bpg3S_oN0U Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:16:12.778946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2671e576de2c44e6b1f5df7c53aae76a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2671e576de2c44e6b1f5df7c53aae76a"}]}] Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 2671e576de2c44e6b1f5df7c53aae76a Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeTestJSON-929758011 Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: e0df4b789a804a00a267bcc5cf778324 Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeTestJSON-929758011-project Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.780535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': 'bfaf5f03-a265-481f-81c5-2f4432079c41'} Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:12.781605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. Jun 30 13:16:12.783091 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:12.784358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] Returning 404 to user: Instance bfaf5f03-a265-481f-81c5-2f4432079c41 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:12.784358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7817865e-e279-4f09-a9e5-ac812f3c59da tempest-AttachVolumeTestJSON-929758011 tempest-AttachVolumeTestJSON-929758011-project] 10.222.0.49 "GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41" status: 404 len: 111 microversion: 2.1 time: 0.032676 Jun 30 13:16:12.784358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 484/954] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:12 2022] GET /compute/v2.1/servers/bfaf5f03-a265-481f-81c5-2f4432079c41 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 13:16:13.761340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-58a361e4-2fea-4e26-bfe5-1c6396cb9e0f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:13.761902 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-58a361e4-2fea-4e26-bfe5-1c6396cb9e0f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:13.769688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a361e4-2fea-4e26-bfe5-1c6396cb9e0f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:13.770123 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a361e4-2fea-4e26-bfe5-1c6396cb9e0f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:13.770939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a361e4-2fea-4e26-bfe5-1c6396cb9e0f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:13.771358 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-58a361e4-2fea-4e26-bfe5-1c6396cb9e0f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:13.911239 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-58a361e4-2fea-4e26-bfe5-1c6396cb9e0f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:13.918984 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-58a361e4-2fea-4e26-bfe5-1c6396cb9e0f tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1448 microversion: 2.1 time: 0.161757 Jun 30 13:16:13.919542 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 471/955] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:13 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:14.357774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-af9488c4-b5e4-42d6-bb80-636fa9594dd9 req-082f991b-b419-4c10-aafe-14cef911f66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6237f937-32a4-40da-aebc-6bc1311b08a4", "name": "network-vif-deleted", "tag": "da28b1a6-cb2b-4c40-9af4-d3051711bd7c"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:16:14.371415 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-af9488c4-b5e4-42d6-bb80-636fa9594dd9 req-082f991b-b419-4c10-aafe-14cef911f66f service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:14.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-af9488c4-b5e4-42d6-bb80-636fa9594dd9 req-082f991b-b419-4c10-aafe-14cef911f66f service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:14.386886 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-af9488c4-b5e4-42d6-bb80-636fa9594dd9 req-082f991b-b419-4c10-aafe-14cef911f66f service nova] Creating event network-vif-deleted:da28b1a6-cb2b-4c40-9af4-d3051711bd7c for instance 6237f937-32a4-40da-aebc-6bc1311b08a4 on hv-cinder-81268 Jun 30 13:16:14.394834 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-af9488c4-b5e4-42d6-bb80-636fa9594dd9 req-082f991b-b419-4c10-aafe-14cef911f66f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041432 Jun 30 13:16:14.396363 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 485/956] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:14.936756 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:14.938421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:14.947216 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:14.948100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:14.948926 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:14.949412 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:14.985753 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:14.986345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:14.986873 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lazy-loading 'fault' on Instance uuid 6237f937-32a4-40da-aebc-6bc1311b08a4 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:16:15.251930 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e51be11f09d44588e5b4ef657907fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19004d450eee426786ca037d00f8fff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:15.282895 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ed49a6dd-05ba-449d-84a1-21e233902ba8 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 200 len: 1222 microversion: 2.1 time: 0.348583 Jun 30 13:16:15.283523 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 472/957] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:14 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 1222 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:16:16.302076 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:16.305537 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] [instance: 6237f937-32a4-40da-aebc-6bc1311b08a4] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:16.315613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:16.317578 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:16.318679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:16.319332 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:16.339646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] HTTP exception thrown: Instance 6237f937-32a4-40da-aebc-6bc1311b08a4 could not be found. Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Request method failure captured: Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 HTTP/1.1 Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivaBYLQWgB6upJdjqiwniy_NuzwS0xzTrgveUV_QcBiTa6aNtexaBtgW-OP7xAzBcz8KuIGqyuJVAJafU6g8knO1C8TSId4FvtJoMBV9ynH1g3SAAZVknrj7hCb75kS-ndvkMWYTmZw5BLlNMicKLuxnC094Rb5wxs0o23sxBmedmbDs Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 19004d450eee426786ca037d00f8fff4 Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-TestShelveInstance-884989881 Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:16:16.341543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/19004d450eee426786ca037d00f8fff4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19004d450eee426786ca037d00f8fff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_19004d450eee426786ca037d00f8fff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/19004d450eee426786ca037d00f8fff4"}]}] Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-TestShelveInstance-884989881 Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 19004d450eee426786ca037d00f8fff4 Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-TestShelveInstance-884989881 Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-TestShelveInstance-884989881-project Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 9e51be11f09d44588e5b4ef657907fe6 Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-TestShelveInstance-884989881-project Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 6237f937-32a4-40da-aebc-6bc1311b08a4 could not be found. Jun 30 13:16:16.342949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '6237f937-32a4-40da-aebc-6bc1311b08a4'} Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6237f937-32a4-40da-aebc-6bc1311b08a4 could not be found. Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:16.343853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6237f937-32a4-40da-aebc-6bc1311b08a4 could not be found. Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6237f937-32a4-40da-aebc-6bc1311b08a4 could not be found. Jun 30 13:16:16.346102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:16.347245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Returning 404 to user: Instance 6237f937-32a4-40da-aebc-6bc1311b08a4 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:16.347245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-298a7342-b35a-4f36-902a-481e8ad1f021 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4" status: 404 len: 111 microversion: 2.1 time: 0.047847 Jun 30 13:16:16.349900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 486/958] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:16 2022] GET /compute/v2.1/servers/6237f937-32a4-40da-aebc-6bc1311b08a4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:16.662803 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1434c9dd-c90e-434d-a299-11f3f239cec0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] Calling method '.version_select at 0x7f4b9f72f820>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:16.682625 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1434c9dd-c90e-434d-a299-11f3f239cec0 tempest-TestShelveInstance-884989881 tempest-TestShelveInstance-884989881-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-11899063" status: 202 len: 0 microversion: 2.1 time: 0.024061 Jun 30 13:16:16.683412 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 473/959] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-11899063 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:16:29.955771 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6054f933-5fe3-4857-ba33-1c69c9c1adbe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:29.956303 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6054f933-5fe3-4857-ba33-1c69c9c1adbe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:29.959019 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:29.959806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:29.965649 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6054f933-5fe3-4857-ba33-1c69c9c1adbe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:29.966084 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6054f933-5fe3-4857-ba33-1c69c9c1adbe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:29.966876 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6054f933-5fe3-4857-ba33-1c69c9c1adbe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:29.967365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6054f933-5fe3-4857-ba33-1c69c9c1adbe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:29.995539 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6054f933-5fe3-4857-ba33-1c69c9c1adbe tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/ips" status: 200 len: 150 microversion: 2.1 time: 0.045652 Jun 30 13:16:29.996107 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 487/960] 10.222.0.49 () {58 vars in 1247 bytes} [Thu Jun 30 13:16:29 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:31.333773 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:31.334575 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:31.338820 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-081d2b16-c8fa-4e82-b558-e8d9b660d894 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b19d2fa-5118-40cd-8131-d84b1e221428"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:16:31.339876 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-081d2b16-c8fa-4e82-b558-e8d9b660d894 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:31.348512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-081d2b16-c8fa-4e82-b558-e8d9b660d894 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:31.348947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-081d2b16-c8fa-4e82-b558-e8d9b660d894 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:31.349699 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-081d2b16-c8fa-4e82-b558-e8d9b660d894 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:31.350126 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-081d2b16-c8fa-4e82-b558-e8d9b660d894 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:31.645646 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-081d2b16-c8fa-4e82-b558-e8d9b660d894 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "POST /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313355 Jun 30 13:16:31.646571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 474/961] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:16:31 2022] POST /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:42.484002 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8279d81f-5b94-452b-9790-ded8a6041b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:42.484541 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8279d81f-5b94-452b-9790-ded8a6041b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:42.486550 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:42.487166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=4 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:42.493330 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8279d81f-5b94-452b-9790-ded8a6041b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:42.493767 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8279d81f-5b94-452b-9790-ded8a6041b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:42.494546 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8279d81f-5b94-452b-9790-ded8a6041b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:42.494947 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8279d81f-5b94-452b-9790-ded8a6041b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:42.581092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-8279d81f-5b94-452b-9790-ded8a6041b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'services' on Instance uuid c73d4484-c128-4beb-a9dc-602509d79178 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:16:42.659722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8279d81f-5b94-452b-9790-ded8a6041b03 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments/2b19d2fa-5118-40cd-8131-d84b1e221428" status: 202 len: 0 microversion: 2.1 time: 0.180183 Jun 30 13:16:42.660309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 488/962] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:16:42 2022] DELETE /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments/2b19d2fa-5118-40cd-8131-d84b1e221428 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:16:42.666750 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:42.667511 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:42.671678 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c3880d0d-ec35-4d72-ab66-db5d0b2d0921 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:42.672744 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c3880d0d-ec35-4d72-ab66-db5d0b2d0921 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:42.680310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3880d0d-ec35-4d72-ab66-db5d0b2d0921 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:42.680734 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3880d0d-ec35-4d72-ab66-db5d0b2d0921 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:42.681485 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3880d0d-ec35-4d72-ab66-db5d0b2d0921 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:42.681937 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c3880d0d-ec35-4d72-ab66-db5d0b2d0921 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:42.711531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c3880d0d-ec35-4d72-ab66-db5d0b2d0921 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046168 Jun 30 13:16:42.712081 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 475/963] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:16:42 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:43.730496 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-00245986-eae8-4be8-9efe-c0fe40647375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:43.731924 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-00245986-eae8-4be8-9efe-c0fe40647375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:43.740536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-00245986-eae8-4be8-9efe-c0fe40647375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:43.741157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-00245986-eae8-4be8-9efe-c0fe40647375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:43.742166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-00245986-eae8-4be8-9efe-c0fe40647375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:43.742776 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-00245986-eae8-4be8-9efe-c0fe40647375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:43.776561 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-00245986-eae8-4be8-9efe-c0fe40647375 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053078 Jun 30 13:16:43.777112 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 489/964] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:16:43 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:44.792690 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4612943b-fdda-48bc-9597-4a524fda2488 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:44.794046 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4612943b-fdda-48bc-9597-4a524fda2488 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:44.804518 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4612943b-fdda-48bc-9597-4a524fda2488 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:44.804990 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4612943b-fdda-48bc-9597-4a524fda2488 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:44.805753 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4612943b-fdda-48bc-9597-4a524fda2488 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:44.806174 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4612943b-fdda-48bc-9597-4a524fda2488 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:44.836177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4612943b-fdda-48bc-9597-4a524fda2488 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050262 Jun 30 13:16:44.836736 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 476/965] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:16:44 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:45.851998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6e6419cd-ecf1-44c6-b0b8-0c22097ab8cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:45.852915 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6e6419cd-ecf1-44c6-b0b8-0c22097ab8cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:45.859813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6e6419cd-ecf1-44c6-b0b8-0c22097ab8cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:45.860275 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6e6419cd-ecf1-44c6-b0b8-0c22097ab8cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:45.860994 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6e6419cd-ecf1-44c6-b0b8-0c22097ab8cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:45.861411 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6e6419cd-ecf1-44c6-b0b8-0c22097ab8cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:45.891222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6e6419cd-ecf1-44c6-b0b8-0c22097ab8cd tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Jun 30 13:16:45.891766 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 490/966] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:16:45 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:46.903060 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5b9ebb85-b7ee-4395-9082-760fc04fd0b8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:46.904000 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5b9ebb85-b7ee-4395-9082-760fc04fd0b8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:46.911061 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b9ebb85-b7ee-4395-9082-760fc04fd0b8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:46.911510 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b9ebb85-b7ee-4395-9082-760fc04fd0b8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:46.912290 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b9ebb85-b7ee-4395-9082-760fc04fd0b8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:46.912719 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5b9ebb85-b7ee-4395-9082-760fc04fd0b8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:46.942202 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5b9ebb85-b7ee-4395-9082-760fc04fd0b8 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043171 Jun 30 13:16:46.942799 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 477/967] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:16:46 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:47.958520 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-59fb7c2d-048f-444b-8ceb-e25f3eaf9943 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:47.959998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-59fb7c2d-048f-444b-8ceb-e25f3eaf9943 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:47.967658 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59fb7c2d-048f-444b-8ceb-e25f3eaf9943 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:47.968118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59fb7c2d-048f-444b-8ceb-e25f3eaf9943 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:47.968926 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59fb7c2d-048f-444b-8ceb-e25f3eaf9943 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:47.969349 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59fb7c2d-048f-444b-8ceb-e25f3eaf9943 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:47.999930 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-59fb7c2d-048f-444b-8ceb-e25f3eaf9943 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048388 Jun 30 13:16:48.000498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 491/968] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:16:47 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:16:48.062009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-252dc589-bfe4-44fc-8b66-8993053d8551 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:48.062730 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-252dc589-bfe4-44fc-8b66-8993053d8551 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:48.069920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252dc589-bfe4-44fc-8b66-8993053d8551 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:48.070487 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252dc589-bfe4-44fc-8b66-8993053d8551 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:48.071411 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252dc589-bfe4-44fc-8b66-8993053d8551 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:48.072130 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-252dc589-bfe4-44fc-8b66-8993053d8551 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:48.098293 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-252dc589-bfe4-44fc-8b66-8993053d8551 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:16:48.174452 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-252dc589-bfe4-44fc-8b66-8993053d8551 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 204 len: 0 microversion: 2.1 time: 0.116283 Jun 30 13:16:48.175078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 478/969] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:16:48 2022] DELETE /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:16:48.183665 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a952c0d4-f71b-4470-94b4-7dbce222231c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:48.184253 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a952c0d4-f71b-4470-94b4-7dbce222231c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:48.190510 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a952c0d4-f71b-4470-94b4-7dbce222231c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:48.190943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a952c0d4-f71b-4470-94b4-7dbce222231c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:48.191896 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a952c0d4-f71b-4470-94b4-7dbce222231c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:48.192156 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a952c0d4-f71b-4470-94b4-7dbce222231c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:48.331877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a952c0d4-f71b-4470-94b4-7dbce222231c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:48.339605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a952c0d4-f71b-4470-94b4-7dbce222231c tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1682 microversion: 2.1 time: 0.160181 Jun 30 13:16:48.340254 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 492/970] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:48 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:49.357753 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b761aabc-f97c-4d07-9164-c25b69869912 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:49.358542 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b761aabc-f97c-4d07-9164-c25b69869912 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:49.364928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b761aabc-f97c-4d07-9164-c25b69869912 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:49.365362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b761aabc-f97c-4d07-9164-c25b69869912 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:49.366115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b761aabc-f97c-4d07-9164-c25b69869912 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:49.366567 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b761aabc-f97c-4d07-9164-c25b69869912 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:49.503887 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b761aabc-f97c-4d07-9164-c25b69869912 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:49.512038 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b761aabc-f97c-4d07-9164-c25b69869912 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1682 microversion: 2.1 time: 0.158711 Jun 30 13:16:49.512604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 479/971] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:49 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:50.529990 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f55289ff-abff-457d-9092-25ccdd2a7b77 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:50.530573 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f55289ff-abff-457d-9092-25ccdd2a7b77 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:50.538037 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f55289ff-abff-457d-9092-25ccdd2a7b77 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:50.538577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f55289ff-abff-457d-9092-25ccdd2a7b77 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:50.539445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f55289ff-abff-457d-9092-25ccdd2a7b77 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:50.539878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f55289ff-abff-457d-9092-25ccdd2a7b77 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:50.789498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f55289ff-abff-457d-9092-25ccdd2a7b77 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:50.798388 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f55289ff-abff-457d-9092-25ccdd2a7b77 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1682 microversion: 2.1 time: 0.272984 Jun 30 13:16:50.799202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 493/972] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:50 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1682 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:51.456568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-c6ba0e8f-b6cf-4c66-97d6-09c550d2cd6b req-8f0135eb-7521-47a9-8324-8b06ed8e60cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73d4484-c128-4beb-a9dc-602509d79178", "name": "network-vif-deleted", "tag": "b01b7382-16fd-4fb5-822c-a375652dd0fe"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:16:51.465633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c6ba0e8f-b6cf-4c66-97d6-09c550d2cd6b req-8f0135eb-7521-47a9-8324-8b06ed8e60cd service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:51.466395 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-c6ba0e8f-b6cf-4c66-97d6-09c550d2cd6b req-8f0135eb-7521-47a9-8324-8b06ed8e60cd service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:51.479387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-c6ba0e8f-b6cf-4c66-97d6-09c550d2cd6b req-8f0135eb-7521-47a9-8324-8b06ed8e60cd service nova] Creating event network-vif-deleted:b01b7382-16fd-4fb5-822c-a375652dd0fe for instance c73d4484-c128-4beb-a9dc-602509d79178 on hv-cinder-81268 Jun 30 13:16:51.484518 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-c6ba0e8f-b6cf-4c66-97d6-09c550d2cd6b req-8f0135eb-7521-47a9-8324-8b06ed8e60cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031487 Jun 30 13:16:51.485340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 480/973] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:16:51.816187 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:51.816780 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:51.823538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:51.824047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:51.825053 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:51.825477 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:51.859782 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:51.860222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:51.860703 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'fault' on Instance uuid c73d4484-c128-4beb-a9dc-602509d79178 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:16:51.902746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:51.911039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-572f2345-4d39-4ba3-9773-c5fa8f05c7f4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1332 microversion: 2.1 time: 0.098873 Jun 30 13:16:51.911605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 494/974] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:51 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:52.929726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:52.930480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:52.937004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:52.937450 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:52.938200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:52.938653 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:52.969546 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:52.969979 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:52.970786 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'fault' on Instance uuid c73d4484-c128-4beb-a9dc-602509d79178 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:16:53.013526 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:53.021096 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-44dbd4dd-7560-44f2-af5f-ae8714529512 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1332 microversion: 2.1 time: 0.096189 Jun 30 13:16:53.021664 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 481/975] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:52 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:54.042368 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:54.043362 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:54.050856 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:54.051294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:54.052054 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:54.052480 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:54.083765 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:54.084208 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:54.084647 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'fault' on Instance uuid c73d4484-c128-4beb-a9dc-602509d79178 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:16:54.127200 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:54.135037 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7c7c5efe-2276-48a0-bc5d-fd847c96e52a tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1332 microversion: 2.1 time: 0.099421 Jun 30 13:16:54.135594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 495/976] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:54 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:55.152567 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:55.153182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:55.161776 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:55.162696 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:55.163662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:55.164168 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:55.203126 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:55.203562 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:55.204026 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.objects.instance [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lazy-loading 'fault' on Instance uuid c73d4484-c128-4beb-a9dc-602509d79178 {{(pid=117825) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:16:55.255968 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126e2b6fc7114ec3bdc1bb3a99fcf752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb73f41e81224744800e167e0eb69863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:16:55.265049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-057b4fc2-3be4-4568-8af1-4107d2b2bb27 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 200 len: 1332 microversion: 2.1 time: 0.116383 Jun 30 13:16:55.265694 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 482/977] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:55 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:16:56.282134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:56.282787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:56.289295 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:56.289811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:56.290600 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:56.291030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:56.304565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 HTTP/1.1 Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:16:56.306217 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:56.307893 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': 'c73d4484-c128-4beb-a9dc-602509d79178'} Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:56.308918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:56.310183 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:56.311745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:56.311745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cd8956a7-fcd1-44e7-9dd8-fc222bd0bcc4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 404 len: 111 microversion: 2.1 time: 0.030566 Jun 30 13:16:56.311745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 496/978] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:56 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:56.316522 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca56fbe6-95bd-476f-aa52-1c10b330b43f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '.version_select at 0x7f4b9ff740d0>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:56.338989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ca56fbe6-95bd-476f-aa52-1c10b330b43f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554972407" status: 202 len: 0 microversion: 2.1 time: 0.026242 Jun 30 13:16:56.339746 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 483/979] 10.222.0.49 () {58 vars in 1220 bytes} [Thu Jun 30 13:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554972407 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:16:58.102288 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:58.102879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:58.109412 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:58.109848 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:58.110679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:58.111133 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:58.126359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 HTTP/1.1 Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:16:58.128146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.129672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': 'c73d4484-c128-4beb-a9dc-602509d79178'} Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:58.130654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.132110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.133611 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:58.133611 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ce44cbd1-aa56-443c-8377-a372ac235b3f tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 404 len: 111 microversion: 2.1 time: 0.031156 Jun 30 13:16:58.133611 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 497/980] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:16:58 2022] DELETE /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 13:16:58.140066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:58.140898 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c73d4484-c128-4beb-a9dc-602509d79178] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:58.147784 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:58.148232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:58.148993 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:58.149425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:58.163726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 HTTP/1.1 Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:16:58.165367 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.166991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': 'c73d4484-c128-4beb-a9dc-602509d79178'} Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:58.167779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. Jun 30 13:16:58.169078 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:58.170213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance c73d4484-c128-4beb-a9dc-602509d79178 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:58.170213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-23f642fc-a2cb-4bd8-8501-3cadc99db135 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178" status: 404 len: 111 microversion: 2.1 time: 0.031390 Jun 30 13:16:58.170213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 484/981] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:58 2022] GET /compute/v2.1/servers/c73d4484-c128-4beb-a9dc-602509d79178 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:59.311433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:59.311926 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:59.319565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:59.320020 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:59.320743 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:59.321195 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:59.335439 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 HTTP/1.1 Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:16:59.336986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.338644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '74c42415-7a22-43a3-a838-5bf551bec846'} Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:59.339549 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.340996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.342447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:59.342447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-09b58f6c-dd56-4869-8c17-53dc7dd2f9b4 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 404 len: 111 microversion: 2.1 time: 0.030840 Jun 30 13:16:59.342447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 498/982] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:16:59 2022] DELETE /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:59.347815 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:59.348429 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 74c42415-7a22-43a3-a838-5bf551bec846] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:59.355164 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:59.355611 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:59.356372 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:59.356809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:59.371182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 HTTP/1.1 Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:16:59.372724 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.374222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '74c42415-7a22-43a3-a838-5bf551bec846'} Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:59.375016 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. Jun 30 13:16:59.376528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.378006 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance 74c42415-7a22-43a3-a838-5bf551bec846 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:59.378006 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7abd6a61-371b-4e38-b604-3f0552ed47a0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846" status: 404 len: 111 microversion: 2.1 time: 0.031165 Jun 30 13:16:59.378006 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 485/983] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:59 2022] GET /compute/v2.1/servers/74c42415-7a22-43a3-a838-5bf551bec846 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:59.382862 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:59.383358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:59.389793 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:59.390236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:59.391121 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:59.391511 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:59.405316 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 HTTP/1.1 Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:16:59.407118 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.408762 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '03580d48-01c9-4c1d-bcb6-39a8914b2374'} Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:59.409652 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.411090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.412529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:59.412529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fe39fd43-e78e-4477-bfbe-7b298b6590a3 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 404 len: 111 microversion: 2.1 time: 0.030255 Jun 30 13:16:59.412529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 499/984] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:16:59 2022] DELETE /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:16:59.417561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:16:59.418204 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: 03580d48-01c9-4c1d-bcb6-39a8914b2374] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:16:59.424924 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:59.425371 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:59.426129 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:16:59.426596 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:16:59.440947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 HTTP/1.1 Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:16:59.442508 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.443981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '03580d48-01c9-4c1d-bcb6-39a8914b2374'} Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:16:59.444808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. Jun 30 13:16:59.446232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:16:59.447539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance 03580d48-01c9-4c1d-bcb6-39a8914b2374 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:16:59.447539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-abb5d5e3-d8a4-4999-92c9-a6e96a16219d tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374" status: 404 len: 111 microversion: 2.1 time: 0.030182 Jun 30 13:16:59.447539 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 486/985] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:16:59 2022] GET /compute/v2.1/servers/03580d48-01c9-4c1d-bcb6-39a8914b2374 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:17:00.587571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:00.588673 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:00.595744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:00.596398 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:00.597392 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:00.598107 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:00.613240 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 HTTP/1.1 Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:17:00.614832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.616286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': 'c10b1702-58cf-40cd-b199-96482a3f4721'} Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:17:00.617123 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.618466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.619797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:17:00.619797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4d6d3ca4-d460-4ea4-badd-e0288d9b1224 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 404 len: 111 microversion: 2.1 time: 0.032691 Jun 30 13:17:00.619797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 500/986] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:17:00 2022] DELETE /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 13:17:00.624846 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:00.625451 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] [instance: c10b1702-58cf-40cd-b199-96482a3f4721] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:00.632722 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:00.633176 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:00.634006 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:00.634617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:00.649504 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] HTTP exception thrown: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Request method failure captured: Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 HTTP/1.1 Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-ymMxA_B_0E7dq_kZGx7Rm2sb42-7ZD7oSSfkbvtlbvjntAIYgkfH6DkSzFMeQlQ4WXyAw240vigxpE_fNlMxcCsDq87J3SWshVDZxdIIItMXzMNr3SsHLQMe6HYdLkjne3mHdslKD_g8Dj0zd836DNCXqyTGF5b6s8pMkGvGK-cQ Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:17:00.651040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fb73f41e81224744800e167e0eb69863"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fb73f41e81224744800e167e0eb69863"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fb73f41e81224744800e167e0eb69863"}]}] Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: fb73f41e81224744800e167e0eb69863 Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560246337 Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 126e2b6fc7114ec3bdc1bb3a99fcf752 Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeNegativeTest-1560246337-project Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.652357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': 'c10b1702-58cf-40cd-b199-96482a3f4721'} Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:17:00.653103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. Jun 30 13:17:00.654438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:00.656564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] Returning 404 to user: Instance c10b1702-58cf-40cd-b199-96482a3f4721 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:17:00.656564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8c8ef253-a387-4231-ab23-e4733ced5eb0 tempest-AttachVolumeNegativeTest-1560246337 tempest-AttachVolumeNegativeTest-1560246337-project] 10.222.0.49 "GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721" status: 404 len: 111 microversion: 2.1 time: 0.031503 Jun 30 13:17:00.656564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 487/987] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:17:00 2022] GET /compute/v2.1/servers/c10b1702-58cf-40cd-b199-96482a3f4721 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:17:04.633229 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1a8ddddb-3a30-4ccb-a2aa-2620372fad08 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:04.635280 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1a8ddddb-3a30-4ccb-a2aa-2620372fad08 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:04.645137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a8ddddb-3a30-4ccb-a2aa-2620372fad08 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:04.645631 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a8ddddb-3a30-4ccb-a2aa-2620372fad08 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:04.646437 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a8ddddb-3a30-4ccb-a2aa-2620372fad08 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:04.647084 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1a8ddddb-3a30-4ccb-a2aa-2620372fad08 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:04.688405 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1a8ddddb-3a30-4ccb-a2aa-2620372fad08 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060361 Jun 30 13:17:04.689402 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 501/988] 10.222.0.49 () {60 vars in 1342 bytes} [Thu Jun 30 13:17:04 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:17:04.779335 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-47175c83-daac-44c3-8d3d-0cde4f4e6166 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:04.780166 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-47175c83-daac-44c3-8d3d-0cde4f4e6166 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:04.788066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47175c83-daac-44c3-8d3d-0cde4f4e6166 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:04.788781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47175c83-daac-44c3-8d3d-0cde4f4e6166 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:04.789505 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47175c83-daac-44c3-8d3d-0cde4f4e6166 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:04.789841 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-47175c83-daac-44c3-8d3d-0cde4f4e6166 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:04.818691 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-47175c83-daac-44c3-8d3d-0cde4f4e6166 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:17:05.054278 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-47175c83-daac-44c3-8d3d-0cde4f4e6166 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 204 len: 0 microversion: 2.20 time: 0.279300 Jun 30 13:17:05.055102 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 488/989] 10.222.0.49 () {60 vars in 1279 bytes} [Thu Jun 30 13:17:04 2022] DELETE /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 13:17:05.064420 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:05.065119 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:05.071783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:05.072302 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:05.073137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:05.073624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:05.213166 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:05.221700 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:05.223282 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:05.224437 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bb334bef-a32f-4324-9ccc-21e8b2574b4d tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.164337 Jun 30 13:17:05.224984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 502/990] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:17:05 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:17:06.244101 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:06.244792 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:06.252115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:06.252545 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:06.253445 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:06.254041 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:06.388794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:06.397009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:06.398512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:06.399666 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-deb0ecb0-f377-4924-8532-584b53cb739c tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.159903 Jun 30 13:17:06.400219 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 489/991] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:17:06 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:17:07.419143 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:07.419758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:07.429137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:07.430929 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:07.432344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:07.433457 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:07.683068 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:07.691786 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:07.693268 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:07.694456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d31c807d-3fe8-4b62-afa3-10bec3aff271 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1721 microversion: 2.20 time: 0.279999 Jun 30 13:17:07.695009 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 503/992] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:17:07 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:17:08.137569 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-99ab6949-fc87-42fb-8d4c-f472f874df8e req-121ed377-84d0-482b-b042-34926c8a5efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9860955c-dc0e-4b24-b696-9de9453da561", "name": "network-vif-deleted", "tag": "4a99638e-5bc5-455f-b4cc-97801113ceea"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:17:08.149132 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-99ab6949-fc87-42fb-8d4c-f472f874df8e req-121ed377-84d0-482b-b042-34926c8a5efb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:08.149755 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-99ab6949-fc87-42fb-8d4c-f472f874df8e req-121ed377-84d0-482b-b042-34926c8a5efb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:08.165090 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-99ab6949-fc87-42fb-8d4c-f472f874df8e req-121ed377-84d0-482b-b042-34926c8a5efb service nova] Creating event network-vif-deleted:4a99638e-5bc5-455f-b4cc-97801113ceea for instance 9860955c-dc0e-4b24-b696-9de9453da561 on hv-cinder-81268 Jun 30 13:17:08.172473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-99ab6949-fc87-42fb-8d4c-f472f874df8e req-121ed377-84d0-482b-b042-34926c8a5efb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040120 Jun 30 13:17:08.174003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 490/993] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:17:08.715451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:08.716116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:08.724921 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:08.725643 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:08.727068 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:08.727686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:08.777639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:08.778092 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:08.778567 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lazy-loading 'fault' on Instance uuid 9860955c-dc0e-4b24-b696-9de9453da561 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:17:08.822709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:08.830088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:08.831644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5e99d5484594d13b113f27e77b37efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee8ced67bdf4b5ca8aa12a8940b9bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:08.832783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-14bc4ecf-f081-4cf8-9532-23b2b711c284 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 200 len: 1370 microversion: 2.20 time: 0.123136 Jun 30 13:17:08.833585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 504/994] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:17:08 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 1370 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 13:17:09.852353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:09.853034 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:09.859672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:09.860111 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:09.860866 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:09.861289 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:09.874925 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] HTTP exception thrown: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Request method failure captured: Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 HTTP/1.1 Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-1_WeMwOSYDc2fWzjoKmXYV6ABIeuoq_d3LwT1vgedQjGG_7KwQh14JiGVPLqVzYuys8Sx18PUUjjFny-LbWxKXBM2f9kkHJB4IHZhyCrR40SANKgMonvLEI_YkYxkpZ8hvufq8m72ojOD-qCVB4CIUjna6gEpYNXY1Opo4D4NEZo Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:17:09.876528 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}] Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: e5e99d5484594d13b113f27e77b37efd Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:09.878301 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '9860955c-dc0e-4b24-b696-9de9453da561'} Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:17:09.879766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:09.881274 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:09.882608 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Returning 404 to user: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:17:09.882608 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-99065a52-c90b-4f01-9b75-f85277a90649 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 404 len: 111 microversion: 2.20 time: 0.029898 Jun 30 13:17:09.882608 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 491/995] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:17:09 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:17:09.886975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ed7155c7-3042-44ce-a3e2-3d2fd2f26112 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '.version_select at 0x7f4ba407cc10>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:09.906541 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ed7155c7-3042-44ce-a3e2-3d2fd2f26112 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545964002" status: 204 len: 0 microversion: 2.20 time: 0.023305 Jun 30 13:17:09.907093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 505/996] 10.222.0.49 () {60 vars in 1258 bytes} [Thu Jun 30 13:17:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545964002 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 13:17:13.816311 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:13.816792 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:13.819577 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:13.825872 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:13.826512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:13.827249 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:13.827672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:13.830726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:13.845408 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] HTTP exception thrown: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Request method failure captured: Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 HTTP/1.1 Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-1_WeMwOSYDc2fWzjoKmXYV6ABIeuoq_d3LwT1vgedQjGG_7KwQh14JiGVPLqVzYuys8Sx18PUUjjFny-LbWxKXBM2f9kkHJB4IHZhyCrR40SANKgMonvLEI_YkYxkpZ8hvufq8m72ojOD-qCVB4CIUjna6gEpYNXY1Opo4D4NEZo Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:17:13.847001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}] Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: e5e99d5484594d13b113f27e77b37efd Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.848689 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '9860955c-dc0e-4b24-b696-9de9453da561'} Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:17:13.849584 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.851122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.852552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Returning 404 to user: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:17:13.852552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-91db497c-a523-4b48-94b5-ea0115e871f2 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 404 len: 111 microversion: 2.20 time: 0.035977 Jun 30 13:17:13.852552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 492/997] 10.222.0.49 () {60 vars in 1279 bytes} [Thu Jun 30 13:17:13 2022] DELETE /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:17:13.857668 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:13.858281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 9860955c-dc0e-4b24-b696-9de9453da561] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:13.860309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:13.866778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:13.867507 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:13.868255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:13.868729 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:13.872455 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:13.886043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] HTTP exception thrown: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Request method failure captured: Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 HTTP/1.1 Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-1_WeMwOSYDc2fWzjoKmXYV6ABIeuoq_d3LwT1vgedQjGG_7KwQh14JiGVPLqVzYuys8Sx18PUUjjFny-LbWxKXBM2f9kkHJB4IHZhyCrR40SANKgMonvLEI_YkYxkpZ8hvufq8m72ojOD-qCVB4CIUjna6gEpYNXY1Opo4D4NEZo Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:17:13.887622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}] Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: e5e99d5484594d13b113f27e77b37efd Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.889300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '9860955c-dc0e-4b24-b696-9de9453da561'} Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:17:13.890075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. Jun 30 13:17:13.891326 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:13.892431 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Returning 404 to user: Instance 9860955c-dc0e-4b24-b696-9de9453da561 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:17:13.892431 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fe219367-4330-4559-a5db-181eab8e83f4 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561" status: 404 len: 111 microversion: 2.20 time: 0.035840 Jun 30 13:17:13.892431 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 506/998] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:17:13 2022] GET /compute/v2.1/servers/9860955c-dc0e-4b24-b696-9de9453da561 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:17:15.028777 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:15.029300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:15.036267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:15.036714 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:15.037496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:15.038185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:15.052002 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] HTTP exception thrown: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Request method failure captured: Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 HTTP/1.1 Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivZ-1_WeMwOSYDc2fWzjoKmXYV6ABIeuoq_d3LwT1vgedQjGG_7KwQh14JiGVPLqVzYuys8Sx18PUUjjFny-LbWxKXBM2f9kkHJB4IHZhyCrR40SANKgMonvLEI_YkYxkpZ8hvufq8m72ojOD-qCVB4CIUjna6gEpYNXY1Opo4D4NEZo Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:17:15.053641 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}] Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: e5e99d5484594d13b113f27e77b37efd Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.055403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '7f2c8af5-6d65-4177-9434-65a1d15813c9'} Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:17:15.059328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.060831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.062387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Returning 404 to user: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:17:15.062387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b1363893-ae0a-4bbb-b3f8-9f495098100b tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 404 len: 111 microversion: 2.20 time: 0.030403 Jun 30 13:17:15.062387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 493/999] 10.222.0.49 () {60 vars in 1279 bytes} [Thu Jun 30 13:17:15 2022] DELETE /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:17:15.064292 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:15.064898 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] [instance: 7f2c8af5-6d65-4177-9434-65a1d15813c9] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:15.071927 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:15.072358 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:15.073212 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:15.073644 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:15.087240 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] HTTP exception thrown: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Request method failure captured: Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 HTTP/1.1 Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivZ-1_WeMwOSYDc2fWzjoKmXYV6ABIeuoq_d3LwT1vgedQjGG_7KwQh14JiGVPLqVzYuys8Sx18PUUjjFny-LbWxKXBM2f9kkHJB4IHZhyCrR40SANKgMonvLEI_YkYxkpZ8hvufq8m72ojOD-qCVB4CIUjna6gEpYNXY1Opo4D4NEZo Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:17:15.088787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cee8ced67bdf4b5ca8aa12a8940b9bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cee8ced67bdf4b5ca8aa12a8940b9bea"}]}] Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: cee8ced67bdf4b5ca8aa12a8940b9bea Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1762871669 Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: e5e99d5484594d13b113f27e77b37efd Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1762871669-project Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.090470 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '7f2c8af5-6d65-4177-9434-65a1d15813c9'} Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:17:15.091274 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. Jun 30 13:17:15.092636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:17:15.093832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] Returning 404 to user: Instance 7f2c8af5-6d65-4177-9434-65a1d15813c9 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:17:15.093832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0cd03024-7e9a-4914-a18d-a30b587547a9 tempest-AttachVolumeShelveTestJSON-1762871669 tempest-AttachVolumeShelveTestJSON-1762871669-project] 10.222.0.49 "GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9" status: 404 len: 111 microversion: 2.20 time: 0.030242 Jun 30 13:17:15.093832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 507/1000] 10.222.0.49 () {60 vars in 1276 bytes} [Thu Jun 30 13:17:15 2022] GET /compute/v2.1/servers/7f2c8af5-6d65-4177-9434-65a1d15813c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 13:17:58.590921 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-172662355", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "networks": [{"uuid": "ff134bdd-7ad2-4cee-91fb-1a0506588014"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:17:58.597993 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:58.598651 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:58.650268 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] validate_networks() for [('ff134bdd-7ad2-4cee-91fb-1a0506588014', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:17:59.036739 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:17:59.037153 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:17:59.037617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:17:59.038019 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:17:59.038414 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:17:59.047973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:59.048419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:59.049353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:17:59.049779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:17:59.069464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Getting quotas for project 3f1179a608f64ede9eb3c4252619f823. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:17:59.073624 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Getting quotas for user e2f423922c784da2be2d16c736a1ec16 and project 3f1179a608f64ede9eb3c4252619f823. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:17:59.085131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:17:59.087474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:17:59.136437 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b68b125a-e120-4776-923e-4ce0fc4f4355 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549700 Jun 30 13:17:59.143561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 494/1001] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:17:59.149070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1db2ed9e-1fcc-4ac9-9fb9-e4b0800e8298 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:17:59.150595 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1db2ed9e-1fcc-4ac9-9fb9-e4b0800e8298 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:17:59.156135 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:59.157053 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:17:59.209847 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1db2ed9e-1fcc-4ac9-9fb9-e4b0800e8298 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:17:59.217338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1db2ed9e-1fcc-4ac9-9fb9-e4b0800e8298 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1213 microversion: 2.1 time: 0.072180 Jun 30 13:17:59.218137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 508/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:17:59 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:00.235359 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-01ff864c-6212-4adf-bf63-ced410857aa5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:00.236557 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-01ff864c-6212-4adf-bf63-ced410857aa5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:00.244805 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ff864c-6212-4adf-bf63-ced410857aa5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:00.245240 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ff864c-6212-4adf-bf63-ced410857aa5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:00.246005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ff864c-6212-4adf-bf63-ced410857aa5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:00.246424 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-01ff864c-6212-4adf-bf63-ced410857aa5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:00.310586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-01ff864c-6212-4adf-bf63-ced410857aa5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:00.318245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-01ff864c-6212-4adf-bf63-ced410857aa5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1265 microversion: 2.1 time: 0.087038 Jun 30 13:18:00.318842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 495/1003] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:00 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:01.336351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5cf95fbe-63e5-4ecc-9e5b-71636a9516e3 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:01.337423 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5cf95fbe-63e5-4ecc-9e5b-71636a9516e3 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:01.345610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cf95fbe-63e5-4ecc-9e5b-71636a9516e3 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:01.346039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cf95fbe-63e5-4ecc-9e5b-71636a9516e3 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:01.347255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cf95fbe-63e5-4ecc-9e5b-71636a9516e3 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:01.347673 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cf95fbe-63e5-4ecc-9e5b-71636a9516e3 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:01.779577 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5cf95fbe-63e5-4ecc-9e5b-71636a9516e3 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:01.790268 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5cf95fbe-63e5-4ecc-9e5b-71636a9516e3 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1313 microversion: 2.1 time: 0.457709 Jun 30 13:18:01.794366 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 509/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:01 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:01.948018 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-cc47d1c0-c770-41d6-ac12-640cb9531eda req-53741899-1f47-43b1-9f65-08d8336824c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb1c138-63d5-42d5-8620-f0ef8049452e", "tag": "c8a16560-4bed-4563-bd36-2e27512dda70"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:01.957048 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-cc47d1c0-c770-41d6-ac12-640cb9531eda req-53741899-1f47-43b1-9f65-08d8336824c1 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:01.957576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-cc47d1c0-c770-41d6-ac12-640cb9531eda req-53741899-1f47-43b1-9f65-08d8336824c1 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:01.976813 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-cc47d1c0-c770-41d6-ac12-640cb9531eda req-53741899-1f47-43b1-9f65-08d8336824c1 service nova] Creating event network-changed:c8a16560-4bed-4563-bd36-2e27512dda70 for instance 9cb1c138-63d5-42d5-8620-f0ef8049452e on hv-cinder-81268 Jun 30 13:18:01.981599 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-cc47d1c0-c770-41d6-ac12-640cb9531eda req-53741899-1f47-43b1-9f65-08d8336824c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245980 Jun 30 13:18:01.983171 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 496/1005] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:18:02.807245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b6f7fc0b-ffe3-4eb7-82fe-709a5dd8e74b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:02.807856 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b6f7fc0b-ffe3-4eb7-82fe-709a5dd8e74b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:02.814621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b6f7fc0b-ffe3-4eb7-82fe-709a5dd8e74b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:02.815054 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b6f7fc0b-ffe3-4eb7-82fe-709a5dd8e74b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:02.815796 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b6f7fc0b-ffe3-4eb7-82fe-709a5dd8e74b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:02.816212 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b6f7fc0b-ffe3-4eb7-82fe-709a5dd8e74b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:02.948682 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b6f7fc0b-ffe3-4eb7-82fe-709a5dd8e74b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:02.958804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b6f7fc0b-ffe3-4eb7-82fe-709a5dd8e74b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1313 microversion: 2.1 time: 0.153710 Jun 30 13:18:02.958804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 510/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:02 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:03.975034 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6918a496-9279-4b45-a7fb-b1b0d04317ba tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:03.976660 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6918a496-9279-4b45-a7fb-b1b0d04317ba tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:03.985911 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6918a496-9279-4b45-a7fb-b1b0d04317ba tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:03.986730 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6918a496-9279-4b45-a7fb-b1b0d04317ba tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:03.988102 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6918a496-9279-4b45-a7fb-b1b0d04317ba tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:03.988848 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6918a496-9279-4b45-a7fb-b1b0d04317ba tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:04.138726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6918a496-9279-4b45-a7fb-b1b0d04317ba tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:04.147193 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6918a496-9279-4b45-a7fb-b1b0d04317ba tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1313 microversion: 2.1 time: 0.177097 Jun 30 13:18:04.147763 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 497/1007] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:03 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:05.166096 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-2bc26374-b652-426d-b846-69c599913b16 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:05.166949 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-2bc26374-b652-426d-b846-69c599913b16 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:05.176148 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2bc26374-b652-426d-b846-69c599913b16 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:05.176830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2bc26374-b652-426d-b846-69c599913b16 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:05.177800 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2bc26374-b652-426d-b846-69c599913b16 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:05.178397 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-2bc26374-b652-426d-b846-69c599913b16 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:05.325657 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-2bc26374-b652-426d-b846-69c599913b16 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:05.333570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-2bc26374-b652-426d-b846-69c599913b16 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1313 microversion: 2.1 time: 0.173013 Jun 30 13:18:05.334159 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 511/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:05 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:18:06.351212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7db5e324-d312-4ada-b8b1-ffdc7567191a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:06.352001 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7db5e324-d312-4ada-b8b1-ffdc7567191a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:06.358968 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7db5e324-d312-4ada-b8b1-ffdc7567191a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:06.359407 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7db5e324-d312-4ada-b8b1-ffdc7567191a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:06.360146 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7db5e324-d312-4ada-b8b1-ffdc7567191a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:06.360566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7db5e324-d312-4ada-b8b1-ffdc7567191a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:06.491023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7db5e324-d312-4ada-b8b1-ffdc7567191a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:06.498723 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7db5e324-d312-4ada-b8b1-ffdc7567191a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1313 microversion: 2.1 time: 0.151262 Jun 30 13:18:06.499585 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 498/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:06 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:07.419723 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-9e9c27dd-fe02-4b4c-9ac5-3d419a312b95 req-a79c0e95-bcc9-4ae4-aa6e-ede4aa036439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb1c138-63d5-42d5-8620-f0ef8049452e", "name": "network-vif-plugged", "status": "completed", "tag": "c8a16560-4bed-4563-bd36-2e27512dda70"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:07.432126 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-9e9c27dd-fe02-4b4c-9ac5-3d419a312b95 req-a79c0e95-bcc9-4ae4-aa6e-ede4aa036439 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:07.432561 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-9e9c27dd-fe02-4b4c-9ac5-3d419a312b95 req-a79c0e95-bcc9-4ae4-aa6e-ede4aa036439 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:07.446351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-9e9c27dd-fe02-4b4c-9ac5-3d419a312b95 req-a79c0e95-bcc9-4ae4-aa6e-ede4aa036439 service nova] Creating event network-vif-plugged:c8a16560-4bed-4563-bd36-2e27512dda70 for instance 9cb1c138-63d5-42d5-8620-f0ef8049452e on hv-cinder-81268 Jun 30 13:18:07.451452 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-9e9c27dd-fe02-4b4c-9ac5-3d419a312b95 req-a79c0e95-bcc9-4ae4-aa6e-ede4aa036439 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187667 Jun 30 13:18:07.452097 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 512/1010] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:18:07.518399 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7149e15e-1139-4308-894a-1afeebcbb37e tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:07.518946 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7149e15e-1139-4308-894a-1afeebcbb37e tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:07.526616 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7149e15e-1139-4308-894a-1afeebcbb37e tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:07.527049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7149e15e-1139-4308-894a-1afeebcbb37e tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:07.527802 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7149e15e-1139-4308-894a-1afeebcbb37e tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:07.528224 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7149e15e-1139-4308-894a-1afeebcbb37e tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:07.709917 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7149e15e-1139-4308-894a-1afeebcbb37e tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:07.718344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7149e15e-1139-4308-894a-1afeebcbb37e tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1313 microversion: 2.1 time: 0.205699 Jun 30 13:18:07.719665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 499/1011] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:07 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:08.741297 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-42c5c937-e0a5-4dba-ad89-fe5ecd0cf9a7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:08.742602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-42c5c937-e0a5-4dba-ad89-fe5ecd0cf9a7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:08.748712 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-42c5c937-e0a5-4dba-ad89-fe5ecd0cf9a7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:08.749163 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-42c5c937-e0a5-4dba-ad89-fe5ecd0cf9a7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:08.749888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-42c5c937-e0a5-4dba-ad89-fe5ecd0cf9a7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:08.750305 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-42c5c937-e0a5-4dba-ad89-fe5ecd0cf9a7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:08.887435 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-42c5c937-e0a5-4dba-ad89-fe5ecd0cf9a7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:08.895134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-42c5c937-e0a5-4dba-ad89-fe5ecd0cf9a7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1313 microversion: 2.1 time: 0.158487 Jun 30 13:18:08.895697 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 513/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:08 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:09.913777 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41db332a-e00e-43a3-bf68-1fbf5eab8b19 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:09.914530 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-41db332a-e00e-43a3-bf68-1fbf5eab8b19 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:09.916911 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:09.917780 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:09.923253 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41db332a-e00e-43a3-bf68-1fbf5eab8b19 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:09.923695 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41db332a-e00e-43a3-bf68-1fbf5eab8b19 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:09.924686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41db332a-e00e-43a3-bf68-1fbf5eab8b19 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:09.925339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41db332a-e00e-43a3-bf68-1fbf5eab8b19 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:10.062675 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-41db332a-e00e-43a3-bf68-1fbf5eab8b19 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:10.070493 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41db332a-e00e-43a3-bf68-1fbf5eab8b19 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1497 microversion: 2.1 time: 0.162062 Jun 30 13:18:10.071069 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 500/1013] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:09 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:10.560427 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-107482ee-4ea3-49a1-937a-69ab5423c6b1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:10.561001 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-107482ee-4ea3-49a1-937a-69ab5423c6b1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:10.563021 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:10.569000 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-107482ee-4ea3-49a1-937a-69ab5423c6b1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:10.569438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-107482ee-4ea3-49a1-937a-69ab5423c6b1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:10.570198 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-107482ee-4ea3-49a1-937a-69ab5423c6b1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:10.570653 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-107482ee-4ea3-49a1-937a-69ab5423c6b1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:10.596729 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-107482ee-4ea3-49a1-937a-69ab5423c6b1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:18:10.690131 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-107482ee-4ea3-49a1-937a-69ab5423c6b1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 204 len: 0 microversion: 2.1 time: 0.133299 Jun 30 13:18:10.691221 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 514/1014] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:18:10 2022] DELETE /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:18:10.700553 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b5324856-9eb9-4375-985d-2942e24d3d81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:10.701399 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b5324856-9eb9-4375-985d-2942e24d3d81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:10.708026 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5324856-9eb9-4375-985d-2942e24d3d81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:10.708465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5324856-9eb9-4375-985d-2942e24d3d81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:10.709308 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5324856-9eb9-4375-985d-2942e24d3d81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:10.709809 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b5324856-9eb9-4375-985d-2942e24d3d81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:10.850551 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b5324856-9eb9-4375-985d-2942e24d3d81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:10.858625 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b5324856-9eb9-4375-985d-2942e24d3d81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1503 microversion: 2.1 time: 0.163166 Jun 30 13:18:10.860198 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 501/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:10 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:11.878100 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e2e05f23-689e-4c37-a04f-49520a994524 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:11.878831 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e2e05f23-689e-4c37-a04f-49520a994524 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:11.885376 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2e05f23-689e-4c37-a04f-49520a994524 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:11.885813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2e05f23-689e-4c37-a04f-49520a994524 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:11.886595 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2e05f23-689e-4c37-a04f-49520a994524 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:11.887109 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e2e05f23-689e-4c37-a04f-49520a994524 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:12.025475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e2e05f23-689e-4c37-a04f-49520a994524 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:12.033610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e2e05f23-689e-4c37-a04f-49520a994524 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1503 microversion: 2.1 time: 0.160097 Jun 30 13:18:12.034172 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 515/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:11 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:12.781525 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-2d7f1035-4d5f-4294-95f0-e4a68637251c req-7a5bb665-ef99-4ee7-85a3-6cf40e058e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb1c138-63d5-42d5-8620-f0ef8049452e", "name": "network-vif-deleted", "tag": "c8a16560-4bed-4563-bd36-2e27512dda70"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:12.790630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-2d7f1035-4d5f-4294-95f0-e4a68637251c req-7a5bb665-ef99-4ee7-85a3-6cf40e058e46 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:12.791127 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-2d7f1035-4d5f-4294-95f0-e4a68637251c req-7a5bb665-ef99-4ee7-85a3-6cf40e058e46 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:12.802976 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-2d7f1035-4d5f-4294-95f0-e4a68637251c req-7a5bb665-ef99-4ee7-85a3-6cf40e058e46 service nova] Creating event network-vif-deleted:c8a16560-4bed-4563-bd36-2e27512dda70 for instance 9cb1c138-63d5-42d5-8620-f0ef8049452e on hv-cinder-81268 Jun 30 13:18:12.811179 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-2d7f1035-4d5f-4294-95f0-e4a68637251c req-7a5bb665-ef99-4ee7-85a3-6cf40e058e46 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033707 Jun 30 13:18:12.811803 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 502/1017] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:18:13.051664 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:13.052461 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:13.059555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:13.060028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:13.060787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:13.061206 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:13.097236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:13.097674 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:13.098114 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lazy-loading 'fault' on Instance uuid 9cb1c138-63d5-42d5-8620-f0ef8049452e {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:18:13.141812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:13.150021 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-20c61dbb-4d81-4006-9178-40f315fe693c tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 200 len: 1303 microversion: 2.1 time: 0.103322 Jun 30 13:18:13.150603 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 516/1018] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:13 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:14.168720 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:14.169403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 9cb1c138-63d5-42d5-8620-f0ef8049452e] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:14.175856 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:14.176292 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:14.177041 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:14.177458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:14.190918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] HTTP exception thrown: Instance 9cb1c138-63d5-42d5-8620-f0ef8049452e could not be found. Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Request method failure captured: Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e HTTP/1.1 Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaKCXOsrjvSF7qSHoWkd-78H__SRFMoOuyZOsJBjlpL5grPvBhSr8BNiN4TyFYylT3ssTDD0-V6YWC1kJbNzl9y8cx5phjbAD4Is9_RBo0aalyurW1uTQJ_PdziCV_McYuviwlc8ZfRLHE8p4zgBroA4SeBNnnUDfHMJ7ap3V0NTqTg Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 3f1179a608f64ede9eb3c4252619f823 Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesActionsTest-1660233365 Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:18:14.192615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3f1179a608f64ede9eb3c4252619f823"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f1179a608f64ede9eb3c4252619f823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3f1179a608f64ede9eb3c4252619f823"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f1179a608f64ede9eb3c4252619f823"}]}] Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesActionsTest-1660233365 Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 3f1179a608f64ede9eb3c4252619f823 Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesActionsTest-1660233365 Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesActionsTest-1660233365-project Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: e2f423922c784da2be2d16c736a1ec16 Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesActionsTest-1660233365-project Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 9cb1c138-63d5-42d5-8620-f0ef8049452e could not be found. Jun 30 13:18:14.194080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '9cb1c138-63d5-42d5-8620-f0ef8049452e'} Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cb1c138-63d5-42d5-8620-f0ef8049452e could not be found. Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:18:14.194933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cb1c138-63d5-42d5-8620-f0ef8049452e could not be found. Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cb1c138-63d5-42d5-8620-f0ef8049452e could not be found. Jun 30 13:18:14.196222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:14.197384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Returning 404 to user: Instance 9cb1c138-63d5-42d5-8620-f0ef8049452e could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:18:14.197384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c8253d8d-a8e2-4088-a27b-d45392f7df4f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e" status: 404 len: 111 microversion: 2.1 time: 0.029959 Jun 30 13:18:14.197384 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 503/1019] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:14 2022] GET /compute/v2.1/servers/9cb1c138-63d5-42d5-8620-f0ef8049452e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:18:14.295001 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-253019373", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452", "networks": [{"uuid": "ff134bdd-7ad2-4cee-91fb-1a0506588014"}]}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:14.349230 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] validate_networks() for [('ff134bdd-7ad2-4cee-91fb-1a0506588014', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:18:14.819657 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:18:14.821056 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:18:14.821676 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:18:14.822300 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:18:14.822733 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:18:14.832490 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:14.832932 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:14.833726 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:14.834155 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:14.852057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Getting quotas for project 3f1179a608f64ede9eb3c4252619f823. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:18:14.856075 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Getting quotas for user e2f423922c784da2be2d16c736a1ec16 and project 3f1179a608f64ede9eb3c4252619f823. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:18:14.867556 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:18:14.869831 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:18:14.916755 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-827d5bdb-71fe-43b1-b64e-927a3b4e72ee tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625418 Jun 30 13:18:14.922863 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 517/1020] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:18:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:18:14.927639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f4e7f40-b1ad-4380-bb6f-2773bede595b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:14.928428 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f4e7f40-b1ad-4380-bb6f-2773bede595b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:15.001557 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f4e7f40-b1ad-4380-bb6f-2773bede595b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:15.008335 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f4e7f40-b1ad-4380-bb6f-2773bede595b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1213 microversion: 2.1 time: 0.084609 Jun 30 13:18:15.017881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 504/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:14 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:16.026127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-82981ca4-d3ce-4566-a258-60e4c484a054 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:16.026958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-82981ca4-d3ce-4566-a258-60e4c484a054 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:16.040182 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-82981ca4-d3ce-4566-a258-60e4c484a054 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:16.040621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-82981ca4-d3ce-4566-a258-60e4c484a054 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:16.041420 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-82981ca4-d3ce-4566-a258-60e4c484a054 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:16.041809 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-82981ca4-d3ce-4566-a258-60e4c484a054 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:16.121563 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-82981ca4-d3ce-4566-a258-60e4c484a054 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:16.131798 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-82981ca4-d3ce-4566-a258-60e4c484a054 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1283 microversion: 2.1 time: 0.110327 Jun 30 13:18:16.132585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 518/1022] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:16 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:17.150424 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-261ab54a-e217-4fc7-b56e-4ac9b9488778 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:17.151657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-261ab54a-e217-4fc7-b56e-4ac9b9488778 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:17.159787 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-261ab54a-e217-4fc7-b56e-4ac9b9488778 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:17.160510 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-261ab54a-e217-4fc7-b56e-4ac9b9488778 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:17.161373 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-261ab54a-e217-4fc7-b56e-4ac9b9488778 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:17.161967 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-261ab54a-e217-4fc7-b56e-4ac9b9488778 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:17.357129 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-261ab54a-e217-4fc7-b56e-4ac9b9488778 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:17.365597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-261ab54a-e217-4fc7-b56e-4ac9b9488778 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.219352 Jun 30 13:18:17.366257 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 505/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:17 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:17.414725 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-80fd048d-aff6-44c7-b6df-fdd70a7e2671 req-c1dd60fe-47c3-4440-90b8-5391d6afd379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae328a4-7a22-4861-97a8-27705e5f84d5", "tag": "898bb614-275e-45c3-b868-e020edfbc546"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:17.425891 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-80fd048d-aff6-44c7-b6df-fdd70a7e2671 req-c1dd60fe-47c3-4440-90b8-5391d6afd379 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:17.426633 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-80fd048d-aff6-44c7-b6df-fdd70a7e2671 req-c1dd60fe-47c3-4440-90b8-5391d6afd379 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:17.440699 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-80fd048d-aff6-44c7-b6df-fdd70a7e2671 req-c1dd60fe-47c3-4440-90b8-5391d6afd379 service nova] Creating event network-changed:898bb614-275e-45c3-b868-e020edfbc546 for instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 on hv-cinder-81268 Jun 30 13:18:17.445622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-80fd048d-aff6-44c7-b6df-fdd70a7e2671 req-c1dd60fe-47c3-4440-90b8-5391d6afd379 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034573 Jun 30 13:18:17.446244 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 519/1024] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:18:18.387745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-29ba9a83-06c7-4119-be5e-5a8dc0852f72 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:18.387745 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-29ba9a83-06c7-4119-be5e-5a8dc0852f72 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:18.391873 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29ba9a83-06c7-4119-be5e-5a8dc0852f72 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:18.392401 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29ba9a83-06c7-4119-be5e-5a8dc0852f72 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:18.393392 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29ba9a83-06c7-4119-be5e-5a8dc0852f72 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:18.393860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-29ba9a83-06c7-4119-be5e-5a8dc0852f72 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:18.529393 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-29ba9a83-06c7-4119-be5e-5a8dc0852f72 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:18.538462 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-29ba9a83-06c7-4119-be5e-5a8dc0852f72 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.158770 Jun 30 13:18:18.539063 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 506/1025] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:18 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:19.561401 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bf08fc97-88b5-4671-9e66-7cd5f08929ae tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:19.562422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bf08fc97-88b5-4671-9e66-7cd5f08929ae tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:19.570238 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf08fc97-88b5-4671-9e66-7cd5f08929ae tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:19.570702 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf08fc97-88b5-4671-9e66-7cd5f08929ae tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:19.571458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf08fc97-88b5-4671-9e66-7cd5f08929ae tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:19.571886 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bf08fc97-88b5-4671-9e66-7cd5f08929ae tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:19.706555 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bf08fc97-88b5-4671-9e66-7cd5f08929ae tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:19.714214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bf08fc97-88b5-4671-9e66-7cd5f08929ae tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.160810 Jun 30 13:18:19.714856 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 520/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:19 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:20.731337 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4d4eaffe-5aef-4b31-8abe-b85661653698 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:20.731947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4d4eaffe-5aef-4b31-8abe-b85661653698 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:20.738751 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d4eaffe-5aef-4b31-8abe-b85661653698 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:20.739193 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d4eaffe-5aef-4b31-8abe-b85661653698 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:20.739944 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d4eaffe-5aef-4b31-8abe-b85661653698 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:20.740393 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4d4eaffe-5aef-4b31-8abe-b85661653698 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:20.874920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-4d4eaffe-5aef-4b31-8abe-b85661653698 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:20.883251 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4d4eaffe-5aef-4b31-8abe-b85661653698 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.155789 Jun 30 13:18:20.883811 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 507/1027] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:20 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:21.902466 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cfbb4298-546c-4b92-a765-5025f3159da7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:21.903098 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cfbb4298-546c-4b92-a765-5025f3159da7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:21.913188 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cfbb4298-546c-4b92-a765-5025f3159da7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:21.913781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cfbb4298-546c-4b92-a765-5025f3159da7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:21.915345 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cfbb4298-546c-4b92-a765-5025f3159da7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:21.916049 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cfbb4298-546c-4b92-a765-5025f3159da7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:22.086265 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cfbb4298-546c-4b92-a765-5025f3159da7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:22.099846 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cfbb4298-546c-4b92-a765-5025f3159da7 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.202714 Jun 30 13:18:22.100686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 521/1028] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:21 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:23.121924 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cfb2fce3-52b0-43d3-8535-210de09e6248 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:23.122915 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cfb2fce3-52b0-43d3-8535-210de09e6248 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:23.134788 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb2fce3-52b0-43d3-8535-210de09e6248 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:23.135349 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb2fce3-52b0-43d3-8535-210de09e6248 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:23.136118 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb2fce3-52b0-43d3-8535-210de09e6248 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:23.136572 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cfb2fce3-52b0-43d3-8535-210de09e6248 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:23.271072 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cfb2fce3-52b0-43d3-8535-210de09e6248 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:23.280863 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cfb2fce3-52b0-43d3-8535-210de09e6248 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.165725 Jun 30 13:18:23.281430 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 508/1029] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:23 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:24.298478 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d8d3ee59-dc1e-4302-a7dd-94a3ebe8edef tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:24.299051 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d8d3ee59-dc1e-4302-a7dd-94a3ebe8edef tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:24.306365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d8d3ee59-dc1e-4302-a7dd-94a3ebe8edef tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:24.306900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d8d3ee59-dc1e-4302-a7dd-94a3ebe8edef tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:24.307642 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d8d3ee59-dc1e-4302-a7dd-94a3ebe8edef tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:24.308062 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d8d3ee59-dc1e-4302-a7dd-94a3ebe8edef tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:24.443928 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d8d3ee59-dc1e-4302-a7dd-94a3ebe8edef tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:24.451783 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d8d3ee59-dc1e-4302-a7dd-94a3ebe8edef tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.157266 Jun 30 13:18:24.452357 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 522/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:24 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:25.470131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-63da19e5-bcb5-447d-a0b2-c4d16e36bd81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:25.470807 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-63da19e5-bcb5-447d-a0b2-c4d16e36bd81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:25.473387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:25.479468 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63da19e5-bcb5-447d-a0b2-c4d16e36bd81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:25.479907 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63da19e5-bcb5-447d-a0b2-c4d16e36bd81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:25.480674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63da19e5-bcb5-447d-a0b2-c4d16e36bd81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:25.481091 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-63da19e5-bcb5-447d-a0b2-c4d16e36bd81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:25.614865 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-63da19e5-bcb5-447d-a0b2-c4d16e36bd81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:25.623239 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-63da19e5-bcb5-447d-a0b2-c4d16e36bd81 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.157846 Jun 30 13:18:25.623808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 509/1031] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:25 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:26.640694 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0d94714b-c4a9-42a8-a5aa-166e886309e8 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:26.641314 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0d94714b-c4a9-42a8-a5aa-166e886309e8 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:26.643303 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:26.643994 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=6 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:26.650711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0d94714b-c4a9-42a8-a5aa-166e886309e8 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:26.651147 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0d94714b-c4a9-42a8-a5aa-166e886309e8 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:26.651911 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0d94714b-c4a9-42a8-a5aa-166e886309e8 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:26.652338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0d94714b-c4a9-42a8-a5aa-166e886309e8 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:26.789781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0d94714b-c4a9-42a8-a5aa-166e886309e8 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:26.797301 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0d94714b-c4a9-42a8-a5aa-166e886309e8 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.160565 Jun 30 13:18:26.797868 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 523/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:26 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:27.815547 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6cefc395-ac3a-4e51-95a0-415affb24d87 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:27.816160 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6cefc395-ac3a-4e51-95a0-415affb24d87 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:27.823295 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cefc395-ac3a-4e51-95a0-415affb24d87 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:27.823739 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cefc395-ac3a-4e51-95a0-415affb24d87 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:27.824513 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cefc395-ac3a-4e51-95a0-415affb24d87 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:27.824941 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6cefc395-ac3a-4e51-95a0-415affb24d87 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:27.954888 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6cefc395-ac3a-4e51-95a0-415affb24d87 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:27.962786 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6cefc395-ac3a-4e51-95a0-415affb24d87 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.152105 Jun 30 13:18:27.963343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 510/1033] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:27 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:28.984211 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5cc732ce-1efb-4984-8e6b-3b8feb6d0b98 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:28.985218 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5cc732ce-1efb-4984-8e6b-3b8feb6d0b98 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:28.996850 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cc732ce-1efb-4984-8e6b-3b8feb6d0b98 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:28.997586 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cc732ce-1efb-4984-8e6b-3b8feb6d0b98 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:28.998890 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cc732ce-1efb-4984-8e6b-3b8feb6d0b98 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:28.999596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5cc732ce-1efb-4984-8e6b-3b8feb6d0b98 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:29.161687 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5cc732ce-1efb-4984-8e6b-3b8feb6d0b98 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:29.170269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5cc732ce-1efb-4984-8e6b-3b8feb6d0b98 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.192761 Jun 30 13:18:29.170870 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 524/1034] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:28 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:29.832183 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-e3572f7a-25c5-4963-9898-e5e720f3ad59 req-d196780f-ddb5-4032-bb7f-fe3ebc3f2936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae328a4-7a22-4861-97a8-27705e5f84d5", "name": "network-vif-plugged", "status": "completed", "tag": "898bb614-275e-45c3-b868-e020edfbc546"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:29.836317 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:29.842097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e3572f7a-25c5-4963-9898-e5e720f3ad59 req-d196780f-ddb5-4032-bb7f-fe3ebc3f2936 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:29.842570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e3572f7a-25c5-4963-9898-e5e720f3ad59 req-d196780f-ddb5-4032-bb7f-fe3ebc3f2936 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:29.846010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=81 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:29.858680 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-e3572f7a-25c5-4963-9898-e5e720f3ad59 req-d196780f-ddb5-4032-bb7f-fe3ebc3f2936 service nova] Creating event network-vif-plugged:898bb614-275e-45c3-b868-e020edfbc546 for instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 on hv-cinder-81268 Jun 30 13:18:29.863875 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-e3572f7a-25c5-4963-9898-e5e720f3ad59 req-d196780f-ddb5-4032-bb7f-fe3ebc3f2936 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035531 Jun 30 13:18:29.864633 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 511/1035] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:18:30.191993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-f86cb135-f2a2-4ce0-9009-e011880fc9d9 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:30.192939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-f86cb135-f2a2-4ce0-9009-e011880fc9d9 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:30.197418 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:30.206734 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f86cb135-f2a2-4ce0-9009-e011880fc9d9 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:30.207459 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f86cb135-f2a2-4ce0-9009-e011880fc9d9 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:30.208719 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f86cb135-f2a2-4ce0-9009-e011880fc9d9 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:30.209422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-f86cb135-f2a2-4ce0-9009-e011880fc9d9 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:30.213679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:30.363892 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-f86cb135-f2a2-4ce0-9009-e011880fc9d9 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:30.371532 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-f86cb135-f2a2-4ce0-9009-e011880fc9d9 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.186190 Jun 30 13:18:30.372198 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 525/1036] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:30 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:31.398610 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1895b6e5-d766-4610-943b-db30c34d02e1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:31.399824 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1895b6e5-d766-4610-943b-db30c34d02e1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:31.410363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1895b6e5-d766-4610-943b-db30c34d02e1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:31.411106 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1895b6e5-d766-4610-943b-db30c34d02e1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:31.412344 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1895b6e5-d766-4610-943b-db30c34d02e1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:31.413041 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1895b6e5-d766-4610-943b-db30c34d02e1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:31.566279 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-1895b6e5-d766-4610-943b-db30c34d02e1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:31.574398 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1895b6e5-d766-4610-943b-db30c34d02e1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.183846 Jun 30 13:18:31.574951 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 512/1037] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:31 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:32.600236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bd65bd31-a250-4c6a-a540-2ce8abd83353 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:32.601760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bd65bd31-a250-4c6a-a540-2ce8abd83353 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:32.611958 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd65bd31-a250-4c6a-a540-2ce8abd83353 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:32.612391 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd65bd31-a250-4c6a-a540-2ce8abd83353 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:32.613146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd65bd31-a250-4c6a-a540-2ce8abd83353 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:32.613565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bd65bd31-a250-4c6a-a540-2ce8abd83353 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:32.759184 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bd65bd31-a250-4c6a-a540-2ce8abd83353 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:32.766909 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bd65bd31-a250-4c6a-a540-2ce8abd83353 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.176555 Jun 30 13:18:32.767495 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 526/1038] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:32 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:33.784713 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e50e47b1-6b76-4dd5-9ef6-0dd54c21773f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:33.785282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e50e47b1-6b76-4dd5-9ef6-0dd54c21773f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:33.792575 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e50e47b1-6b76-4dd5-9ef6-0dd54c21773f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:33.793014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e50e47b1-6b76-4dd5-9ef6-0dd54c21773f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:33.793767 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e50e47b1-6b76-4dd5-9ef6-0dd54c21773f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:33.794197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e50e47b1-6b76-4dd5-9ef6-0dd54c21773f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:33.939464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e50e47b1-6b76-4dd5-9ef6-0dd54c21773f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:33.947878 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e50e47b1-6b76-4dd5-9ef6-0dd54c21773f tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.167068 Jun 30 13:18:33.948428 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 513/1039] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:33 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:34.964941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5fc81a42-a4d6-4c38-bfdd-055db70ef104 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:34.965508 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5fc81a42-a4d6-4c38-bfdd-055db70ef104 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:34.973050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5fc81a42-a4d6-4c38-bfdd-055db70ef104 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:34.973455 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5fc81a42-a4d6-4c38-bfdd-055db70ef104 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:34.974202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5fc81a42-a4d6-4c38-bfdd-055db70ef104 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:34.974656 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5fc81a42-a4d6-4c38-bfdd-055db70ef104 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:35.123143 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5fc81a42-a4d6-4c38-bfdd-055db70ef104 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:35.131287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5fc81a42-a4d6-4c38-bfdd-055db70ef104 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1313 microversion: 2.1 time: 0.170335 Jun 30 13:18:35.131843 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 527/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:34 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:36.152663 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90be9110-94ce-44ec-bafd-18c22d728af1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:36.153300 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90be9110-94ce-44ec-bafd-18c22d728af1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:36.163062 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90be9110-94ce-44ec-bafd-18c22d728af1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:36.163576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90be9110-94ce-44ec-bafd-18c22d728af1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:36.164661 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90be9110-94ce-44ec-bafd-18c22d728af1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:36.165210 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90be9110-94ce-44ec-bafd-18c22d728af1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:36.300905 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-90be9110-94ce-44ec-bafd-18c22d728af1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:36.308685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90be9110-94ce-44ec-bafd-18c22d728af1 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1497 microversion: 2.1 time: 0.160280 Jun 30 13:18:36.309250 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 514/1041] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:36 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:18:40.932436 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-681d9b5b-15b5-4c9d-a4a6-77236eddce0a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:40.933003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-681d9b5b-15b5-4c9d-a4a6-77236eddce0a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:40.940124 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-681d9b5b-15b5-4c9d-a4a6-77236eddce0a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:40.940594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-681d9b5b-15b5-4c9d-a4a6-77236eddce0a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:40.941338 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-681d9b5b-15b5-4c9d-a4a6-77236eddce0a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:40.941760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-681d9b5b-15b5-4c9d-a4a6-77236eddce0a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:40.967792 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-681d9b5b-15b5-4c9d-a4a6-77236eddce0a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:18:41.050745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-681d9b5b-15b5-4c9d-a4a6-77236eddce0a tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 204 len: 0 microversion: 2.1 time: 0.122492 Jun 30 13:18:41.051335 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 528/1042] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:18:40 2022] DELETE /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:18:41.060746 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b87c12c1-9c07-469f-bfa6-ee4684c21f1d tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:41.061356 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b87c12c1-9c07-469f-bfa6-ee4684c21f1d tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:41.067885 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b87c12c1-9c07-469f-bfa6-ee4684c21f1d tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:41.068365 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b87c12c1-9c07-469f-bfa6-ee4684c21f1d tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:41.069132 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b87c12c1-9c07-469f-bfa6-ee4684c21f1d tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:41.069563 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b87c12c1-9c07-469f-bfa6-ee4684c21f1d tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:41.206011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b87c12c1-9c07-469f-bfa6-ee4684c21f1d tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:41.216150 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b87c12c1-9c07-469f-bfa6-ee4684c21f1d tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1503 microversion: 2.1 time: 0.159988 Jun 30 13:18:41.216721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 515/1043] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:41 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:42.239259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5b858e53-43db-45d3-8f6d-40ccf623aa36 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:42.240390 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5b858e53-43db-45d3-8f6d-40ccf623aa36 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:42.248402 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5b858e53-43db-45d3-8f6d-40ccf623aa36 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:42.248838 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5b858e53-43db-45d3-8f6d-40ccf623aa36 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:42.249585 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5b858e53-43db-45d3-8f6d-40ccf623aa36 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:42.250001 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5b858e53-43db-45d3-8f6d-40ccf623aa36 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:42.384498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5b858e53-43db-45d3-8f6d-40ccf623aa36 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:42.392259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5b858e53-43db-45d3-8f6d-40ccf623aa36 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1503 microversion: 2.1 time: 0.160312 Jun 30 13:18:42.392839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 529/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:42 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:43.409569 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8a6b6783-b7ca-4206-ba9a-37e58223d461 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:43.410180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8a6b6783-b7ca-4206-ba9a-37e58223d461 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:43.417600 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a6b6783-b7ca-4206-ba9a-37e58223d461 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:43.418040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a6b6783-b7ca-4206-ba9a-37e58223d461 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:43.418836 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a6b6783-b7ca-4206-ba9a-37e58223d461 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:43.419262 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8a6b6783-b7ca-4206-ba9a-37e58223d461 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:43.559335 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8a6b6783-b7ca-4206-ba9a-37e58223d461 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:43.567336 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8a6b6783-b7ca-4206-ba9a-37e58223d461 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1503 microversion: 2.1 time: 0.161690 Jun 30 13:18:43.567897 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 516/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:43 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:44.588500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a566a0df-cedc-4735-ac08-6773cadfed8b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:44.589349 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a566a0df-cedc-4735-ac08-6773cadfed8b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:44.600797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a566a0df-cedc-4735-ac08-6773cadfed8b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:44.601526 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a566a0df-cedc-4735-ac08-6773cadfed8b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:44.602831 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a566a0df-cedc-4735-ac08-6773cadfed8b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:44.603529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a566a0df-cedc-4735-ac08-6773cadfed8b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:44.738993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a566a0df-cedc-4735-ac08-6773cadfed8b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:44.751032 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a566a0df-cedc-4735-ac08-6773cadfed8b tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1503 microversion: 2.1 time: 0.168980 Jun 30 13:18:44.751839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 530/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:44 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:45.775413 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a6b98375-1090-40a5-be0b-0f91a81fa605 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:45.776080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a6b98375-1090-40a5-be0b-0f91a81fa605 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:45.784441 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6b98375-1090-40a5-be0b-0f91a81fa605 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:45.784974 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6b98375-1090-40a5-be0b-0f91a81fa605 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:45.785866 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6b98375-1090-40a5-be0b-0f91a81fa605 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:45.786369 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a6b98375-1090-40a5-be0b-0f91a81fa605 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:45.933997 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a6b98375-1090-40a5-be0b-0f91a81fa605 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:45.941623 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a6b98375-1090-40a5-be0b-0f91a81fa605 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1503 microversion: 2.1 time: 0.172719 Jun 30 13:18:45.942182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 517/1047] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:45 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:46.962718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9bcba318-8e6e-40a6-926e-033eaa1ede10 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:46.964630 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9bcba318-8e6e-40a6-926e-033eaa1ede10 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:46.976178 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9bcba318-8e6e-40a6-926e-033eaa1ede10 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:46.976901 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9bcba318-8e6e-40a6-926e-033eaa1ede10 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:46.978692 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9bcba318-8e6e-40a6-926e-033eaa1ede10 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:46.979122 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9bcba318-8e6e-40a6-926e-033eaa1ede10 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:47.111910 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9bcba318-8e6e-40a6-926e-033eaa1ede10 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:47.123042 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9bcba318-8e6e-40a6-926e-033eaa1ede10 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1503 microversion: 2.1 time: 0.166749 Jun 30 13:18:47.123804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 531/1048] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:46 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:47.984555 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-8616dfd2-460c-4e74-93ac-7cfcf7d94de7 req-13a1b069-c001-45c2-acc2-cc98395249e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae328a4-7a22-4861-97a8-27705e5f84d5", "name": "network-vif-unplugged", "status": "completed", "tag": "898bb614-275e-45c3-b868-e020edfbc546"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:47.993970 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8616dfd2-460c-4e74-93ac-7cfcf7d94de7 req-13a1b069-c001-45c2-acc2-cc98395249e6 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:47.994462 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-8616dfd2-460c-4e74-93ac-7cfcf7d94de7 req-13a1b069-c001-45c2-acc2-cc98395249e6 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:48.012670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-8616dfd2-460c-4e74-93ac-7cfcf7d94de7 req-13a1b069-c001-45c2-acc2-cc98395249e6 service nova] Creating event network-vif-unplugged:898bb614-275e-45c3-b868-e020edfbc546 for instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 on hv-cinder-81268 Jun 30 13:18:48.018188 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-8616dfd2-460c-4e74-93ac-7cfcf7d94de7 req-13a1b069-c001-45c2-acc2-cc98395249e6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038023 Jun 30 13:18:48.019363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 518/1049] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:18:48.141340 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-08e4e8c2-7525-4dba-86eb-4935b647f252 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:48.141952 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-08e4e8c2-7525-4dba-86eb-4935b647f252 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:48.148811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-08e4e8c2-7525-4dba-86eb-4935b647f252 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:48.149245 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-08e4e8c2-7525-4dba-86eb-4935b647f252 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:48.149999 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-08e4e8c2-7525-4dba-86eb-4935b647f252 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:48.150740 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-08e4e8c2-7525-4dba-86eb-4935b647f252 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:48.288322 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-08e4e8c2-7525-4dba-86eb-4935b647f252 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:48.296731 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-08e4e8c2-7525-4dba-86eb-4935b647f252 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1503 microversion: 2.1 time: 0.159727 Jun 30 13:18:48.297309 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 532/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:48 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:48.314622 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-97a81a95-7064-4edb-88a6-7b7cf7934146 req-29de84d1-e345-4b48-9085-7c0eca76c26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae328a4-7a22-4861-97a8-27705e5f84d5", "name": "network-vif-deleted", "tag": "898bb614-275e-45c3-b868-e020edfbc546"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:48.323394 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-97a81a95-7064-4edb-88a6-7b7cf7934146 req-29de84d1-e345-4b48-9085-7c0eca76c26a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:48.323842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-97a81a95-7064-4edb-88a6-7b7cf7934146 req-29de84d1-e345-4b48-9085-7c0eca76c26a service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:48.336122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-97a81a95-7064-4edb-88a6-7b7cf7934146 req-29de84d1-e345-4b48-9085-7c0eca76c26a service nova] Creating event network-vif-deleted:898bb614-275e-45c3-b868-e020edfbc546 for instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 on hv-cinder-81268 Jun 30 13:18:48.340960 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-97a81a95-7064-4edb-88a6-7b7cf7934146 req-29de84d1-e345-4b48-9085-7c0eca76c26a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030491 Jun 30 13:18:48.341797 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 519/1051] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:18:48.597551 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-17bf0ef9-6e77-43d4-b76a-ade61d8b9111 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:48.598197 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-17bf0ef9-6e77-43d4-b76a-ade61d8b9111 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:48.607187 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-17bf0ef9-6e77-43d4-b76a-ade61d8b9111 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:48.607621 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-17bf0ef9-6e77-43d4-b76a-ade61d8b9111 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:48.608380 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-17bf0ef9-6e77-43d4-b76a-ade61d8b9111 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:48.608797 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-17bf0ef9-6e77-43d4-b76a-ade61d8b9111 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:48.633970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-17bf0ef9-6e77-43d4-b76a-ade61d8b9111 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:18:48.715632 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-17bf0ef9-6e77-43d4-b76a-ade61d8b9111 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 204 len: 0 microversion: 2.1 time: 0.124884 Jun 30 13:18:48.716485 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 533/1052] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:18:48 2022] DELETE /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:18:48.725564 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b85c78bf-fcdf-4001-800a-9cc47476d459 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:48.726258 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b85c78bf-fcdf-4001-800a-9cc47476d459 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:48.733180 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b85c78bf-fcdf-4001-800a-9cc47476d459 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:48.733629 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b85c78bf-fcdf-4001-800a-9cc47476d459 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:48.734423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b85c78bf-fcdf-4001-800a-9cc47476d459 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:48.734850 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b85c78bf-fcdf-4001-800a-9cc47476d459 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:48.870014 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b85c78bf-fcdf-4001-800a-9cc47476d459 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:48.878022 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b85c78bf-fcdf-4001-800a-9cc47476d459 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1576 microversion: 2.1 time: 0.157015 Jun 30 13:18:48.878602 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 520/1053] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:48 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:49.318032 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:49.318777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:49.327018 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:49.327428 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:49.328216 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:49.328640 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:49.360877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:49.361353 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:49.361793 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lazy-loading 'fault' on Instance uuid 4ae328a4-7a22-4861-97a8-27705e5f84d5 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:18:49.407685 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2f423922c784da2be2d16c736a1ec16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1179a608f64ede9eb3c4252619f823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:49.418355 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c953ae9a-e12b-49ac-b104-b9a6db59c9a5 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 200 len: 1303 microversion: 2.1 time: 0.107011 Jun 30 13:18:49.419033 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 534/1054] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:49 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:18:49.898005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8611e72a-c336-4016-9b09-bf42ac3729ec tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:49.898928 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8611e72a-c336-4016-9b09-bf42ac3729ec tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:49.906064 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8611e72a-c336-4016-9b09-bf42ac3729ec tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:49.906538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8611e72a-c336-4016-9b09-bf42ac3729ec tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:49.907291 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8611e72a-c336-4016-9b09-bf42ac3729ec tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:49.907714 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8611e72a-c336-4016-9b09-bf42ac3729ec tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:50.051463 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8611e72a-c336-4016-9b09-bf42ac3729ec tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:50.059207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8611e72a-c336-4016-9b09-bf42ac3729ec tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1576 microversion: 2.1 time: 0.166927 Jun 30 13:18:50.059767 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 521/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:49 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:50.440714 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:50.441329 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] [instance: 4ae328a4-7a22-4861-97a8-27705e5f84d5] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:50.448021 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:50.448729 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:50.449498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:50.449931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:50.470631 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] HTTP exception thrown: Instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 could not be found. Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Request method failure captured: Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 HTTP/1.1 Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivaKCXOsrjvSF7qSHoWkd-78H__SRFMoOuyZOsJBjlpL5grPvBhSr8BNiN4TyFYylT3ssTDD0-V6YWC1kJbNzl9y8cx5phjbAD4Is9_RBo0aalyurW1uTQJ_PdziCV_McYuviwlc8ZfRLHE8p4zgBroA4SeBNnnUDfHMJ7ap3V0NTqTg Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 3f1179a608f64ede9eb3c4252619f823 Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-VolumesActionsTest-1660233365 Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:18:50.472597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3f1179a608f64ede9eb3c4252619f823"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f1179a608f64ede9eb3c4252619f823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3f1179a608f64ede9eb3c4252619f823"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3f1179a608f64ede9eb3c4252619f823"}]}] Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-VolumesActionsTest-1660233365 Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 3f1179a608f64ede9eb3c4252619f823 Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-VolumesActionsTest-1660233365 Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-VolumesActionsTest-1660233365-project Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: e2f423922c784da2be2d16c736a1ec16 Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-VolumesActionsTest-1660233365-project Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 could not be found. Jun 30 13:18:50.474289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '4ae328a4-7a22-4861-97a8-27705e5f84d5'} Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 could not be found. Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:18:50.475458 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 could not be found. Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 could not be found. Jun 30 13:18:50.477597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:18:50.479060 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] Returning 404 to user: Instance 4ae328a4-7a22-4861-97a8-27705e5f84d5 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:18:50.482235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6dc03f40-0d1b-4641-8e96-fc047831adb2 tempest-VolumesActionsTest-1660233365 tempest-VolumesActionsTest-1660233365-project] 10.222.0.49 "GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5" status: 404 len: 111 microversion: 2.1 time: 0.045382 Jun 30 13:18:50.482933 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 535/1056] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:50 2022] GET /compute/v2.1/servers/4ae328a4-7a22-4861-97a8-27705e5f84d5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:18:51.078196 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e7352e24-0849-4506-847e-3125e886b07d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:51.079527 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e7352e24-0849-4506-847e-3125e886b07d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:51.086973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7352e24-0849-4506-847e-3125e886b07d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:51.087643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7352e24-0849-4506-847e-3125e886b07d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:51.089226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7352e24-0849-4506-847e-3125e886b07d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:51.089954 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e7352e24-0849-4506-847e-3125e886b07d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:51.325131 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e7352e24-0849-4506-847e-3125e886b07d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:51.332829 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e7352e24-0849-4506-847e-3125e886b07d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1576 microversion: 2.1 time: 0.260416 Jun 30 13:18:51.333432 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 522/1057] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:51 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1576 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:51.709102 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-3611b14e-8e18-47f3-b26d-c798e27ee51d req-128b8be3-dde0-4f19-9a33-c94904c7d629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5339395e-cb3b-47b8-a0c6-a695a9909c35", "name": "network-vif-deleted", "tag": "aa66d3a4-6b5c-49bd-ab08-db82f057af26"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:51.718112 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3611b14e-8e18-47f3-b26d-c798e27ee51d req-128b8be3-dde0-4f19-9a33-c94904c7d629 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:51.718909 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-3611b14e-8e18-47f3-b26d-c798e27ee51d req-128b8be3-dde0-4f19-9a33-c94904c7d629 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:51.732061 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-3611b14e-8e18-47f3-b26d-c798e27ee51d req-128b8be3-dde0-4f19-9a33-c94904c7d629 service nova] Creating event network-vif-deleted:aa66d3a4-6b5c-49bd-ab08-db82f057af26 for instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 on hv-cinder-81268 Jun 30 13:18:51.737234 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-3611b14e-8e18-47f3-b26d-c798e27ee51d req-128b8be3-dde0-4f19-9a33-c94904c7d629 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Jun 30 13:18:51.737831 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 536/1058] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:18:52.350771 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-db5b9309-4c15-4476-beff-5095e0901139 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:52.351340 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-db5b9309-4c15-4476-beff-5095e0901139 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:52.358359 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db5b9309-4c15-4476-beff-5095e0901139 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:52.358834 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db5b9309-4c15-4476-beff-5095e0901139 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:52.359606 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db5b9309-4c15-4476-beff-5095e0901139 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:52.360009 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-db5b9309-4c15-4476-beff-5095e0901139 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:52.424696 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-db5b9309-4c15-4476-beff-5095e0901139 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:52.433222 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-db5b9309-4c15-4476-beff-5095e0901139 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1509 microversion: 2.1 time: 0.086312 Jun 30 13:18:52.434269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 523/1059] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:52 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1509 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:53.456570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8f285cfb-4a50-4930-a58b-5bfb1994c5fe tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:53.457723 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8f285cfb-4a50-4930-a58b-5bfb1994c5fe tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:53.466821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8f285cfb-4a50-4930-a58b-5bfb1994c5fe tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:53.467259 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8f285cfb-4a50-4930-a58b-5bfb1994c5fe tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:53.468020 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8f285cfb-4a50-4930-a58b-5bfb1994c5fe tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:53.468445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8f285cfb-4a50-4930-a58b-5bfb1994c5fe tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:53.535613 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8f285cfb-4a50-4930-a58b-5bfb1994c5fe tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:53.543925 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8f285cfb-4a50-4930-a58b-5bfb1994c5fe tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1225 microversion: 2.1 time: 0.095294 Jun 30 13:18:53.544487 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 537/1060] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:53 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:54.565586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-17946eb4-12e1-4dbe-9032-c73423606632 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:54.566459 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-17946eb4-12e1-4dbe-9032-c73423606632 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:54.576044 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17946eb4-12e1-4dbe-9032-c73423606632 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:54.576480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17946eb4-12e1-4dbe-9032-c73423606632 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:54.577227 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17946eb4-12e1-4dbe-9032-c73423606632 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:54.577650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-17946eb4-12e1-4dbe-9032-c73423606632 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:54.640943 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-17946eb4-12e1-4dbe-9032-c73423606632 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:54.648970 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-17946eb4-12e1-4dbe-9032-c73423606632 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1225 microversion: 2.1 time: 0.089982 Jun 30 13:18:54.649534 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 524/1061] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:54 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:55.670791 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c43c3756-f382-4f29-8cd8-d3366b62822f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:55.671741 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c43c3756-f382-4f29-8cd8-d3366b62822f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:55.683044 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c43c3756-f382-4f29-8cd8-d3366b62822f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:55.683499 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c43c3756-f382-4f29-8cd8-d3366b62822f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:55.684366 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c43c3756-f382-4f29-8cd8-d3366b62822f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:55.684792 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c43c3756-f382-4f29-8cd8-d3366b62822f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:55.757320 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c43c3756-f382-4f29-8cd8-d3366b62822f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:55.765432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c43c3756-f382-4f29-8cd8-d3366b62822f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 200 len: 1225 microversion: 2.1 time: 0.101237 Jun 30 13:18:55.765992 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 538/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:55 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:56.784806 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:56.786578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:56.793607 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:56.794135 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:56.795018 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:56.795497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:56.809561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] HTTP exception thrown: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Request method failure captured: Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 HTTP/1.1 Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaHeaMLQDWDEkEcYhwlTJb0Azr_YPeT-t7IosrBU3PabAfwPpZpJaUclala3EJNxqM8rpWtoJLVp9wt8X33wXc-XX9fFXHmi33hBJxifQvUeJMGXgHb7vKyz2UDaPLROHeiRQdrpy7tkSGlv68OZKrusx-Uush6W5e5fdylXzp_ChZk Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:18:56.811245 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}] Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestVolumeBootPattern-845338843 Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 1c4aa9e4d27c4c2ea4b49ab188f841da Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:18:56.813005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '5339395e-cb3b-47b8-a0c6-a695a9909c35'} Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:18:56.814025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:18:56.815667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:18:56.816963 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Returning 404 to user: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:18:56.816963 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c6c5e8af-51d5-4ef1-9503-6b70fc1743fd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 404 len: 111 microversion: 2.1 time: 0.033139 Jun 30 13:18:56.816963 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 525/1063] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:56 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:18:56.913344 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1244773730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2015083666", "security_groups": [{"name": "tempest-secgroup-smoke-590072109"}], "block_device_mapping_v2": [{"uuid": "7d1f3d74-4e01-4dc9-b278-adbb48913c96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c0d94028-8912-4867-bb69-bc96650821f0"}]}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:18:57.033587 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.network.neutron [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] validate_networks() for [('c0d94028-8912-4867-bb69-bc96650821f0', None, None, None, None, None)] {{(pid=117826) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:18:57.532514 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Flavor limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:18:57.532929 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Image limits 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:18:57.533707 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Flavor pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:18:57.534570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Image pref 0:0:0 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:18:57.535250 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.virt.hardware [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:18:57.551501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:57.553385 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:57.555134 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:57.556251 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:57.577740 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Getting quotas for project 80ff68a0b07e43d4bdb9c32f7166c9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:18:57.583593 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Getting quotas for user 1c4aa9e4d27c4c2ea4b49ab188f841da and project 80ff68a0b07e43d4bdb9c32f7166c9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:18:57.672972 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Going to run 1 instances... {{(pid=117826) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:18:57.676148 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d1f3d74-4e01-4dc9-b278-adbb48913c96',volume_size=None,volume_type=None)] {{(pid=117826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:18:57.848335 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a7cdf408-dabb-45b9-ba39-24466fd7f9d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.938902 Jun 30 13:18:57.849187 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 539/1064] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:18:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:18:57.860620 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c76dd1ce-e6eb-4061-b99b-910f4f37bfc9 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:57.865003 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c76dd1ce-e6eb-4061-b99b-910f4f37bfc9 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:57.966811 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c76dd1ce-e6eb-4061-b99b-910f4f37bfc9 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:57.979059 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c76dd1ce-e6eb-4061-b99b-910f4f37bfc9 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1095 microversion: 2.1 time: 0.121997 Jun 30 13:18:57.981091 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 526/1065] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:57 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1095 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:18:59.000224 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-10dbe67d-e170-4542-b8b0-d1c8132d0478 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:18:59.001538 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-10dbe67d-e170-4542-b8b0-d1c8132d0478 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:18:59.016785 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-10dbe67d-e170-4542-b8b0-d1c8132d0478 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:59.017224 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-10dbe67d-e170-4542-b8b0-d1c8132d0478 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:59.018210 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-10dbe67d-e170-4542-b8b0-d1c8132d0478 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:18:59.018670 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-10dbe67d-e170-4542-b8b0-d1c8132d0478 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:18:59.024830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:18:59.129631 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-10dbe67d-e170-4542-b8b0-d1c8132d0478 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:18:59.143260 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-10dbe67d-e170-4542-b8b0-d1c8132d0478 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1193 microversion: 2.1 time: 0.147783 Jun 30 13:18:59.143871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 540/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:18:58 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1193 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:00.161918 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca2ae4c5-ba9d-42ea-8b29-57bb06e60a88 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:00.163066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ca2ae4c5-ba9d-42ea-8b29-57bb06e60a88 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:00.172303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=34 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:00.188128 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca2ae4c5-ba9d-42ea-8b29-57bb06e60a88 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:00.188580 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca2ae4c5-ba9d-42ea-8b29-57bb06e60a88 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:00.191455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca2ae4c5-ba9d-42ea-8b29-57bb06e60a88 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:00.193565 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca2ae4c5-ba9d-42ea-8b29-57bb06e60a88 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:00.256108 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=74 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:00.558967 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ca2ae4c5-ba9d-42ea-8b29-57bb06e60a88 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:00.568559 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ca2ae4c5-ba9d-42ea-8b29-57bb06e60a88 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1278 microversion: 2.1 time: 0.410822 Jun 30 13:19:00.569678 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 527/1067] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:00 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:01.355406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-b7b808a4-89be-4a96-9d5b-0c60fe016dc5 req-c77e2d07-1f54-4cca-853b-bb8c0d644575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85fcb5a3-550c-4487-88ea-d2b76619ef26", "tag": "4d7204da-de14-40a4-a2b5-d7cc301b8618"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:01.362174 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:01.373468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-b7b808a4-89be-4a96-9d5b-0c60fe016dc5 req-c77e2d07-1f54-4cca-853b-bb8c0d644575 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:01.374108 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-b7b808a4-89be-4a96-9d5b-0c60fe016dc5 req-c77e2d07-1f54-4cca-853b-bb8c0d644575 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:01.393293 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-b7b808a4-89be-4a96-9d5b-0c60fe016dc5 req-c77e2d07-1f54-4cca-853b-bb8c0d644575 service nova] Creating event network-changed:4d7204da-de14-40a4-a2b5-d7cc301b8618 for instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 on hv-cinder-81268 Jun 30 13:19:01.399224 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-b7b808a4-89be-4a96-9d5b-0c60fe016dc5 req-c77e2d07-1f54-4cca-853b-bb8c0d644575 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047768 Jun 30 13:19:01.408681 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 541/1068] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:01.588360 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf51dd86-00b5-430d-9f59-32a308794cf2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:01.590184 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf51dd86-00b5-430d-9f59-32a308794cf2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:01.599363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf51dd86-00b5-430d-9f59-32a308794cf2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:01.600230 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf51dd86-00b5-430d-9f59-32a308794cf2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:01.601342 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf51dd86-00b5-430d-9f59-32a308794cf2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:01.602091 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf51dd86-00b5-430d-9f59-32a308794cf2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:01.836397 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-bf51dd86-00b5-430d-9f59-32a308794cf2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:01.844558 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf51dd86-00b5-430d-9f59-32a308794cf2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.260944 Jun 30 13:19:01.845139 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 528/1069] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:01 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:02.862990 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-03a9781a-a245-4e05-ae58-639ab32e4826 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:02.864308 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-03a9781a-a245-4e05-ae58-639ab32e4826 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:02.873249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03a9781a-a245-4e05-ae58-639ab32e4826 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:02.873728 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03a9781a-a245-4e05-ae58-639ab32e4826 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:02.874513 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03a9781a-a245-4e05-ae58-639ab32e4826 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:02.874943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-03a9781a-a245-4e05-ae58-639ab32e4826 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:03.114711 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-03a9781a-a245-4e05-ae58-639ab32e4826 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:03.123502 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-03a9781a-a245-4e05-ae58-639ab32e4826 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.264827 Jun 30 13:19:03.135103 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 542/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:02 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:04.155119 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-2e7763ed-14fd-415a-b002-53f31374ff67 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:04.155753 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-2e7763ed-14fd-415a-b002-53f31374ff67 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:04.162771 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e7763ed-14fd-415a-b002-53f31374ff67 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:04.163456 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e7763ed-14fd-415a-b002-53f31374ff67 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:04.164519 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e7763ed-14fd-415a-b002-53f31374ff67 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:04.165405 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-2e7763ed-14fd-415a-b002-53f31374ff67 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:04.347866 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-2e7763ed-14fd-415a-b002-53f31374ff67 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:04.356468 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-2e7763ed-14fd-415a-b002-53f31374ff67 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.207165 Jun 30 13:19:04.357303 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 529/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:04 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:05.377933 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-cefb1387-8ca0-466e-ae4c-1f4c71178bcd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:05.378668 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-cefb1387-8ca0-466e-ae4c-1f4c71178bcd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:05.387795 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cefb1387-8ca0-466e-ae4c-1f4c71178bcd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:05.388840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cefb1387-8ca0-466e-ae4c-1f4c71178bcd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:05.389824 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cefb1387-8ca0-466e-ae4c-1f4c71178bcd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:05.390262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-cefb1387-8ca0-466e-ae4c-1f4c71178bcd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:05.633682 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-cefb1387-8ca0-466e-ae4c-1f4c71178bcd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:05.644334 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-cefb1387-8ca0-466e-ae4c-1f4c71178bcd tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.271936 Jun 30 13:19:05.655845 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 543/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:05 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:06.669068 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-158625f1-44c9-4438-b5ab-89cfba1d77f6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:06.669832 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-158625f1-44c9-4438-b5ab-89cfba1d77f6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:06.678020 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-158625f1-44c9-4438-b5ab-89cfba1d77f6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:06.678968 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-158625f1-44c9-4438-b5ab-89cfba1d77f6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:06.680445 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-158625f1-44c9-4438-b5ab-89cfba1d77f6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:06.681529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-158625f1-44c9-4438-b5ab-89cfba1d77f6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:06.902612 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-158625f1-44c9-4438-b5ab-89cfba1d77f6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:06.922074 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-158625f1-44c9-4438-b5ab-89cfba1d77f6 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.258263 Jun 30 13:19:06.932310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 530/1073] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:06 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:07.944287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fd3e1157-0cb7-4365-a434-17eda4ceb8d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:07.958889 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fd3e1157-0cb7-4365-a434-17eda4ceb8d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:07.967104 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:07.970229 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=6 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:07.980140 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fd3e1157-0cb7-4365-a434-17eda4ceb8d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:07.981422 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fd3e1157-0cb7-4365-a434-17eda4ceb8d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:07.985324 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fd3e1157-0cb7-4365-a434-17eda4ceb8d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:07.986558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fd3e1157-0cb7-4365-a434-17eda4ceb8d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:08.173190 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-fd3e1157-0cb7-4365-a434-17eda4ceb8d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:08.188562 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fd3e1157-0cb7-4365-a434-17eda4ceb8d8 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.251608 Jun 30 13:19:08.191378 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 544/1074] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:07 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:19:09.209882 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e55bde15-96ba-4aca-9f14-99313e6ddd99 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:09.210466 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e55bde15-96ba-4aca-9f14-99313e6ddd99 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:09.221465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:09.229859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e55bde15-96ba-4aca-9f14-99313e6ddd99 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:09.230594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e55bde15-96ba-4aca-9f14-99313e6ddd99 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:09.232667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e55bde15-96ba-4aca-9f14-99313e6ddd99 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:09.233833 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e55bde15-96ba-4aca-9f14-99313e6ddd99 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:09.611973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e55bde15-96ba-4aca-9f14-99313e6ddd99 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:09.622976 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e55bde15-96ba-4aca-9f14-99313e6ddd99 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.417799 Jun 30 13:19:09.624295 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 531/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:09 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:10.642777 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-afe7118e-1bee-446e-b276-dc8cd3775829 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:10.645482 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-afe7118e-1bee-446e-b276-dc8cd3775829 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:10.658225 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-afe7118e-1bee-446e-b276-dc8cd3775829 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:10.661674 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-afe7118e-1bee-446e-b276-dc8cd3775829 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:10.662785 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-afe7118e-1bee-446e-b276-dc8cd3775829 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:10.665475 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-afe7118e-1bee-446e-b276-dc8cd3775829 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:10.890426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-afe7118e-1bee-446e-b276-dc8cd3775829 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:10.903447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-afe7118e-1bee-446e-b276-dc8cd3775829 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.265307 Jun 30 13:19:10.904415 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 545/1076] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:10 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:11.927421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7cbc5a83-2d4c-4695-bc42-7f02f5c0efbf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:11.927959 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7cbc5a83-2d4c-4695-bc42-7f02f5c0efbf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:11.947093 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cbc5a83-2d4c-4695-bc42-7f02f5c0efbf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:11.948743 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cbc5a83-2d4c-4695-bc42-7f02f5c0efbf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:11.954670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cbc5a83-2d4c-4695-bc42-7f02f5c0efbf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:11.955213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7cbc5a83-2d4c-4695-bc42-7f02f5c0efbf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:12.243079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7cbc5a83-2d4c-4695-bc42-7f02f5c0efbf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:12.252981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7cbc5a83-2d4c-4695-bc42-7f02f5c0efbf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.330446 Jun 30 13:19:12.261343 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 532/1077] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:11 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:13.277828 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-661ad42e-538d-4cc9-8042-0d14c8067a53 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:13.279257 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-661ad42e-538d-4cc9-8042-0d14c8067a53 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:13.294005 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-661ad42e-538d-4cc9-8042-0d14c8067a53 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:13.295146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-661ad42e-538d-4cc9-8042-0d14c8067a53 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:13.296337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-661ad42e-538d-4cc9-8042-0d14c8067a53 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:13.298071 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-661ad42e-538d-4cc9-8042-0d14c8067a53 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:13.465417 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-661ad42e-538d-4cc9-8042-0d14c8067a53 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:13.475353 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-661ad42e-538d-4cc9-8042-0d14c8067a53 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.202315 Jun 30 13:19:13.487175 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 546/1078] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:13 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:19:13.756198 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-32826e86-ed15-44b2-977a-bd98b46bad6a req-a3a4ebc2-4e61-4923-80ab-05a0a8e79628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85fcb5a3-550c-4487-88ea-d2b76619ef26", "name": "network-vif-plugged", "status": "completed", "tag": "4d7204da-de14-40a4-a2b5-d7cc301b8618"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:13.767079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-32826e86-ed15-44b2-977a-bd98b46bad6a req-a3a4ebc2-4e61-4923-80ab-05a0a8e79628 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:13.767891 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-32826e86-ed15-44b2-977a-bd98b46bad6a req-a3a4ebc2-4e61-4923-80ab-05a0a8e79628 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:13.780409 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-32826e86-ed15-44b2-977a-bd98b46bad6a req-a3a4ebc2-4e61-4923-80ab-05a0a8e79628 service nova] Creating event network-vif-plugged:4d7204da-de14-40a4-a2b5-d7cc301b8618 for instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 on hv-cinder-81268 Jun 30 13:19:13.788555 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-32826e86-ed15-44b2-977a-bd98b46bad6a req-a3a4ebc2-4e61-4923-80ab-05a0a8e79628 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036099 Jun 30 13:19:13.793171 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 533/1079] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:14.493914 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6d0a3109-dd09-4087-82f3-1839bd374caa tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:14.495948 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6d0a3109-dd09-4087-82f3-1839bd374caa tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:14.529113 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d0a3109-dd09-4087-82f3-1839bd374caa tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:14.529850 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d0a3109-dd09-4087-82f3-1839bd374caa tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:14.530938 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d0a3109-dd09-4087-82f3-1839bd374caa tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:14.531661 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6d0a3109-dd09-4087-82f3-1839bd374caa tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:14.697162 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6d0a3109-dd09-4087-82f3-1839bd374caa tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:14.706148 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6d0a3109-dd09-4087-82f3-1839bd374caa tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.216374 Jun 30 13:19:14.707612 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 547/1080] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:14 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:15.726387 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-19714482-0814-4f04-8870-8ec336bef548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:15.727117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-19714482-0814-4f04-8870-8ec336bef548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:15.741712 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19714482-0814-4f04-8870-8ec336bef548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:15.750832 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19714482-0814-4f04-8870-8ec336bef548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:15.752141 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19714482-0814-4f04-8870-8ec336bef548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:15.752794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-19714482-0814-4f04-8870-8ec336bef548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:16.026406 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-19714482-0814-4f04-8870-8ec336bef548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:16.040066 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-19714482-0814-4f04-8870-8ec336bef548 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1266 microversion: 2.1 time: 0.319071 Jun 30 13:19:16.040657 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 534/1081] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:15 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:17.064791 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7adc5587-e85e-46c5-a545-e74ee5b9d46a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:17.065816 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7adc5587-e85e-46c5-a545-e74ee5b9d46a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:17.088945 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7adc5587-e85e-46c5-a545-e74ee5b9d46a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:17.091735 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7adc5587-e85e-46c5-a545-e74ee5b9d46a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:17.095177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7adc5587-e85e-46c5-a545-e74ee5b9d46a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:17.096298 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7adc5587-e85e-46c5-a545-e74ee5b9d46a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:17.392488 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7adc5587-e85e-46c5-a545-e74ee5b9d46a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:17.415020 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7adc5587-e85e-46c5-a545-e74ee5b9d46a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1452 microversion: 2.1 time: 0.359135 Jun 30 13:19:17.417655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 548/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:17 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1452 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:17.435293 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-7e97f48a-64ef-4f7e-b1ed-d0ed76c12567 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:17.441244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-7e97f48a-64ef-4f7e-b1ed-d0ed76c12567 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:17.459410 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e97f48a-64ef-4f7e-b1ed-d0ed76c12567 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:17.469638 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e97f48a-64ef-4f7e-b1ed-d0ed76c12567 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:17.474556 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e97f48a-64ef-4f7e-b1ed-d0ed76c12567 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:17.478938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-7e97f48a-64ef-4f7e-b1ed-d0ed76c12567 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:17.812279 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-7e97f48a-64ef-4f7e-b1ed-d0ed76c12567 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:17.829186 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-7e97f48a-64ef-4f7e-b1ed-d0ed76c12567 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1452 microversion: 2.1 time: 0.397047 Jun 30 13:19:17.862836 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 535/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:17 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1452 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:21.946832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-1cd4c7dc-883e-4ebc-b9da-acb463e0fd33 req-a05eb3b1-154a-4875-bc63-f57da3434deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85fcb5a3-550c-4487-88ea-d2b76619ef26", "tag": "4d7204da-de14-40a4-a2b5-d7cc301b8618"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:21.971315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-1cd4c7dc-883e-4ebc-b9da-acb463e0fd33 req-a05eb3b1-154a-4875-bc63-f57da3434deb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:21.972750 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-1cd4c7dc-883e-4ebc-b9da-acb463e0fd33 req-a05eb3b1-154a-4875-bc63-f57da3434deb service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:21.986343 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-1cd4c7dc-883e-4ebc-b9da-acb463e0fd33 req-a05eb3b1-154a-4875-bc63-f57da3434deb service nova] Creating event network-changed:4d7204da-de14-40a4-a2b5-d7cc301b8618 for instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 on hv-cinder-81268 Jun 30 13:19:22.016073 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-1cd4c7dc-883e-4ebc-b9da-acb463e0fd33 req-a05eb3b1-154a-4875-bc63-f57da3434deb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.514499 Jun 30 13:19:22.018654 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 549/1084] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:24.345603 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2060465425", "imageRef": "d1e0460a-c261-4c8e-9a76-fcd85ae47ae2", "flavorRef": "452"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:24.423583 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] validate_networks() for None {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:19:24.797996 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:19:24.798748 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:19:24.799386 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:19:24.799784 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:19:24.800185 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:19:24.811945 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:24.812385 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:24.813171 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:24.813597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:24.832554 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Getting quotas for project 77afad84e1a04d0683cc754a62c51609. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:19:24.836948 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Getting quotas for user 5e85350136a84c7e866f3246070e58f8 and project 77afad84e1a04d0683cc754a62c51609. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:19:24.849351 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:19:24.851665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1e0460a-c261-4c8e-9a76-fcd85ae47ae2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:19:24.925261 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-d12be719-c004-443e-808f-46031775c863 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585129 Jun 30 13:19:24.928267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 536/1085] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:19:24.937965 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-793f712f-8637-47f6-8d63-9247ea9078be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:24.939442 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-793f712f-8637-47f6-8d63-9247ea9078be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:25.009294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-793f712f-8637-47f6-8d63-9247ea9078be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:25.016438 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-793f712f-8637-47f6-8d63-9247ea9078be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1215 microversion: 2.1 time: 0.083384 Jun 30 13:19:25.021072 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 550/1086] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:24 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:19:26.041639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b8e7bf8e-5f59-4d56-b2a8-089baf1b7613 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:26.043206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b8e7bf8e-5f59-4d56-b2a8-089baf1b7613 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:26.051005 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8e7bf8e-5f59-4d56-b2a8-089baf1b7613 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:26.051864 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8e7bf8e-5f59-4d56-b2a8-089baf1b7613 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:26.052904 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8e7bf8e-5f59-4d56-b2a8-089baf1b7613 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:26.053561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b8e7bf8e-5f59-4d56-b2a8-089baf1b7613 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:26.174607 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b8e7bf8e-5f59-4d56-b2a8-089baf1b7613 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:26.186207 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b8e7bf8e-5f59-4d56-b2a8-089baf1b7613 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1267 microversion: 2.1 time: 0.152013 Jun 30 13:19:26.192181 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 537/1087] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:26 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:27.213384 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-456f1608-9759-44f8-b983-0163bb1644a0 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:27.215542 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-456f1608-9759-44f8-b983-0163bb1644a0 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:27.237203 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-456f1608-9759-44f8-b983-0163bb1644a0 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:27.240001 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-456f1608-9759-44f8-b983-0163bb1644a0 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:27.241066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-456f1608-9759-44f8-b983-0163bb1644a0 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:27.241602 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-456f1608-9759-44f8-b983-0163bb1644a0 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:27.409298 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-456f1608-9759-44f8-b983-0163bb1644a0 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:27.419503 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-456f1608-9759-44f8-b983-0163bb1644a0 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.214586 Jun 30 13:19:27.429878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 551/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:27 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:27.916544 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-f17d339d-f188-432b-b3d3-c94e37512ca1 req-3af868e8-c311-49de-a6c4-c49f8f66a8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "732da64f-9401-49ec-b675-4c173f23652a", "tag": "dff194e8-1419-4520-9e12-9a7ae73e57aa"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:27.931687 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f17d339d-f188-432b-b3d3-c94e37512ca1 req-3af868e8-c311-49de-a6c4-c49f8f66a8ce service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:27.933200 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-f17d339d-f188-432b-b3d3-c94e37512ca1 req-3af868e8-c311-49de-a6c4-c49f8f66a8ce service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:27.974838 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-f17d339d-f188-432b-b3d3-c94e37512ca1 req-3af868e8-c311-49de-a6c4-c49f8f66a8ce service nova] Creating event network-changed:dff194e8-1419-4520-9e12-9a7ae73e57aa for instance 732da64f-9401-49ec-b675-4c173f23652a on hv-cinder-81268 Jun 30 13:19:27.990986 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-f17d339d-f188-432b-b3d3-c94e37512ca1 req-3af868e8-c311-49de-a6c4-c49f8f66a8ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079762 Jun 30 13:19:27.991943 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 538/1089] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:28.437832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-0c4a8053-7a0c-4c26-9168-dca997a3eb86 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:28.439141 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-0c4a8053-7a0c-4c26-9168-dca997a3eb86 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:28.445720 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0c4a8053-7a0c-4c26-9168-dca997a3eb86 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:28.446389 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0c4a8053-7a0c-4c26-9168-dca997a3eb86 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:28.447184 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0c4a8053-7a0c-4c26-9168-dca997a3eb86 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:28.447766 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-0c4a8053-7a0c-4c26-9168-dca997a3eb86 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:28.610789 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-0c4a8053-7a0c-4c26-9168-dca997a3eb86 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:28.618297 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-0c4a8053-7a0c-4c26-9168-dca997a3eb86 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.186301 Jun 30 13:19:28.618899 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 552/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:28 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:29.637537 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-74b8d7c8-c590-4106-8f90-8b98dd43573b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:29.637537 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-74b8d7c8-c590-4106-8f90-8b98dd43573b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:29.644760 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74b8d7c8-c590-4106-8f90-8b98dd43573b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:29.645194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74b8d7c8-c590-4106-8f90-8b98dd43573b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:29.646182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74b8d7c8-c590-4106-8f90-8b98dd43573b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:29.646639 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-74b8d7c8-c590-4106-8f90-8b98dd43573b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:29.797941 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-74b8d7c8-c590-4106-8f90-8b98dd43573b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:29.807589 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-74b8d7c8-c590-4106-8f90-8b98dd43573b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.175722 Jun 30 13:19:29.808597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 539/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:29 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:30.608330 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-72f95d70-86dd-4c2e-8352-759306ebe502 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Action: 'create', calling method: .version_select at 0x7f4ba4103d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1608258662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO0BHtxKf6albmUpP1VvquDBlKWApx0eZpn59VTEwJV9KzTWem+1vp8Bz6QmHJtFWQJqpn5qsKiy5zdEmhdVSZP5iZBuwGR/FVjmqfs6ADSkRYmBKgJpj4ZogK9hfrEyw=="}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:30.623107 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-72f95d70-86dd-4c2e-8352-759306ebe502 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Getting quotas for project 810dd4c41fca4b11938e32d08221c9b8. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:19:30.627523 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.quota [None req-72f95d70-86dd-4c2e-8352-759306ebe502 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Getting quotas for user d23750f160a445c083ad823e9b2f2d7b and project 810dd4c41fca4b11938e32d08221c9b8. Resources: {'key_pairs'} {{(pid=117826) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:19:30.651684 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-72f95d70-86dd-4c2e-8352-759306ebe502 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047073 Jun 30 13:19:30.652464 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 553/1092] 10.222.0.49 () {60 vars in 1158 bytes} [Thu Jun 30 13:19:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:30.747428 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-141111531", "imageRef": "e579910b-ae9e-4dde-b220-63bc46541813", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1608258662", "networks": [{"uuid": "c7843374-dc0f-40bb-861b-0b7ed8398a1e"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:30.754597 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:30.801226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] validate_networks() for [('c7843374-dc0f-40bb-861b-0b7ed8398a1e', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:19:30.825165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9b322830-26ee-4eff-9230-55aa20e982b5 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:30.825804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9b322830-26ee-4eff-9230-55aa20e982b5 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:30.832323 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b322830-26ee-4eff-9230-55aa20e982b5 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:30.833022 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b322830-26ee-4eff-9230-55aa20e982b5 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:30.833817 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b322830-26ee-4eff-9230-55aa20e982b5 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:30.834254 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9b322830-26ee-4eff-9230-55aa20e982b5 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:30.837884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=64 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:30.972487 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-9b322830-26ee-4eff-9230-55aa20e982b5 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:30.980578 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9b322830-26ee-4eff-9230-55aa20e982b5 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.159401 Jun 30 13:19:30.981236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 554/1093] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:30 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:31.333546 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:19:31.333968 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:19:31.334490 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:19:31.334869 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:19:31.335267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:19:31.344698 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:31.345143 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:31.345933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:31.346378 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:31.353115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=66 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:31.364486 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Getting quotas for project 810dd4c41fca4b11938e32d08221c9b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:19:31.368573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Getting quotas for user d23750f160a445c083ad823e9b2f2d7b and project 810dd4c41fca4b11938e32d08221c9b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:19:31.379940 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:19:31.382134 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e579910b-ae9e-4dde-b220-63bc46541813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:19:31.439068 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-90d44991-a5ed-4e50-ae68-b0b3b4a405dc tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695686 Jun 30 13:19:31.439734 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 540/1094] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:19:31.450002 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-95e510f0-28dd-4759-bfe3-a16d3159d63d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:31.450629 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-95e510f0-28dd-4759-bfe3-a16d3159d63d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:31.503772 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-95e510f0-28dd-4759-bfe3-a16d3159d63d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:31.511093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-95e510f0-28dd-4759-bfe3-a16d3159d63d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1258 microversion: 2.1 time: 0.065105 Jun 30 13:19:31.511832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 555/1095] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:31 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:31.997789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-baa035fc-6a7e-4fcc-82f0-fcf4b8d0cbc1 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:31.998306 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-baa035fc-6a7e-4fcc-82f0-fcf4b8d0cbc1 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:32.005950 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baa035fc-6a7e-4fcc-82f0-fcf4b8d0cbc1 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:32.006458 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baa035fc-6a7e-4fcc-82f0-fcf4b8d0cbc1 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:32.007221 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baa035fc-6a7e-4fcc-82f0-fcf4b8d0cbc1 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:32.007650 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-baa035fc-6a7e-4fcc-82f0-fcf4b8d0cbc1 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:32.142084 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-baa035fc-6a7e-4fcc-82f0-fcf4b8d0cbc1 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:32.150551 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-baa035fc-6a7e-4fcc-82f0-fcf4b8d0cbc1 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.156796 Jun 30 13:19:32.151473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 541/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:31 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:32.529330 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-25b4da7d-b081-4a02-b315-6f084c1667b4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:32.530570 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-25b4da7d-b081-4a02-b315-6f084c1667b4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:32.539688 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-25b4da7d-b081-4a02-b315-6f084c1667b4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:32.540222 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-25b4da7d-b081-4a02-b315-6f084c1667b4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:32.541266 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-25b4da7d-b081-4a02-b315-6f084c1667b4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:32.541787 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-25b4da7d-b081-4a02-b315-6f084c1667b4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:32.612247 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-25b4da7d-b081-4a02-b315-6f084c1667b4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:32.627383 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-25b4da7d-b081-4a02-b315-6f084c1667b4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1318 microversion: 2.1 time: 0.102681 Jun 30 13:19:32.628349 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 556/1097] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:32 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1318 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:33.168860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-a898096c-33f5-42c0-b116-4bf059c8dad8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:33.169755 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-a898096c-33f5-42c0-b116-4bf059c8dad8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:33.183368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a898096c-33f5-42c0-b116-4bf059c8dad8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:33.183368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a898096c-33f5-42c0-b116-4bf059c8dad8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:33.183368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a898096c-33f5-42c0-b116-4bf059c8dad8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:33.183368 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-a898096c-33f5-42c0-b116-4bf059c8dad8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:33.420892 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-a898096c-33f5-42c0-b116-4bf059c8dad8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:33.439681 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-a898096c-33f5-42c0-b116-4bf059c8dad8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.275211 Jun 30 13:19:33.442202 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 542/1098] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:33 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:33.645832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8e8c2273-a5f2-49ec-8882-a6e25c58cc7d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:33.646566 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8e8c2273-a5f2-49ec-8882-a6e25c58cc7d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:33.649010 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:33.658592 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e8c2273-a5f2-49ec-8882-a6e25c58cc7d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:33.662558 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e8c2273-a5f2-49ec-8882-a6e25c58cc7d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:33.663709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e8c2273-a5f2-49ec-8882-a6e25c58cc7d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:33.664342 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e8c2273-a5f2-49ec-8882-a6e25c58cc7d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:33.760991 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-22429164-2e46-4ea4-a66f-94663d41c241 req-8825b0f7-f47d-4e50-a1fe-5a9e5f77a180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732da64f-9401-49ec-b675-4c173f23652a", "name": "network-vif-plugged", "status": "completed", "tag": "dff194e8-1419-4520-9e12-9a7ae73e57aa"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:33.789679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-22429164-2e46-4ea4-a66f-94663d41c241 req-8825b0f7-f47d-4e50-a1fe-5a9e5f77a180 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:33.791137 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-22429164-2e46-4ea4-a66f-94663d41c241 req-8825b0f7-f47d-4e50-a1fe-5a9e5f77a180 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:33.820779 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-22429164-2e46-4ea4-a66f-94663d41c241 req-8825b0f7-f47d-4e50-a1fe-5a9e5f77a180 service nova] Creating event network-vif-plugged:dff194e8-1419-4520-9e12-9a7ae73e57aa for instance 732da64f-9401-49ec-b675-4c173f23652a on hv-cinder-81268 Jun 30 13:19:33.836317 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-22429164-2e46-4ea4-a66f-94663d41c241 req-8825b0f7-f47d-4e50-a1fe-5a9e5f77a180 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080190 Jun 30 13:19:33.837507 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 543/1099] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:19:33.845406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8e8c2273-a5f2-49ec-8882-a6e25c58cc7d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:33.855887 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8e8c2273-a5f2-49ec-8882-a6e25c58cc7d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.214389 Jun 30 13:19:33.857050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 557/1100] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:33 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:34.459852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-171a2de7-f801-46ac-b3fa-57b032f337a8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:34.462040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-171a2de7-f801-46ac-b3fa-57b032f337a8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:34.469851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-171a2de7-f801-46ac-b3fa-57b032f337a8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:34.470371 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-171a2de7-f801-46ac-b3fa-57b032f337a8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:34.471348 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-171a2de7-f801-46ac-b3fa-57b032f337a8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:34.471973 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-171a2de7-f801-46ac-b3fa-57b032f337a8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:34.614507 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-171a2de7-f801-46ac-b3fa-57b032f337a8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:34.624374 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-171a2de7-f801-46ac-b3fa-57b032f337a8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.169322 Jun 30 13:19:34.625243 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 544/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:34 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:34.876114 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6020b6b3-dddf-4495-97ff-10ea0914e535 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:34.876768 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6020b6b3-dddf-4495-97ff-10ea0914e535 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:34.883790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6020b6b3-dddf-4495-97ff-10ea0914e535 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:34.884248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6020b6b3-dddf-4495-97ff-10ea0914e535 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:34.885996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6020b6b3-dddf-4495-97ff-10ea0914e535 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:34.886463 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6020b6b3-dddf-4495-97ff-10ea0914e535 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:35.028774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6020b6b3-dddf-4495-97ff-10ea0914e535 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:35.039789 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6020b6b3-dddf-4495-97ff-10ea0914e535 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.167668 Jun 30 13:19:35.041267 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 558/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:34 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:35.641465 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-281792bd-7e2c-46af-936c-4a538bd94e25 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:35.642084 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-281792bd-7e2c-46af-936c-4a538bd94e25 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:35.648721 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-281792bd-7e2c-46af-936c-4a538bd94e25 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:35.649152 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-281792bd-7e2c-46af-936c-4a538bd94e25 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:35.650287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-281792bd-7e2c-46af-936c-4a538bd94e25 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:35.651586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-281792bd-7e2c-46af-936c-4a538bd94e25 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:35.793023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-281792bd-7e2c-46af-936c-4a538bd94e25 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:35.803100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-281792bd-7e2c-46af-936c-4a538bd94e25 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.165398 Jun 30 13:19:35.803799 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 545/1103] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:35 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:36.058056 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-7b2463e7-7257-4482-bf56-f536f8dd08fb tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:36.058985 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-7b2463e7-7257-4482-bf56-f536f8dd08fb tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:36.065592 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7b2463e7-7257-4482-bf56-f536f8dd08fb tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:36.066031 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7b2463e7-7257-4482-bf56-f536f8dd08fb tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:36.066867 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7b2463e7-7257-4482-bf56-f536f8dd08fb tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:36.067294 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-7b2463e7-7257-4482-bf56-f536f8dd08fb tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:36.209237 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-7b2463e7-7257-4482-bf56-f536f8dd08fb tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:36.217786 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-7b2463e7-7257-4482-bf56-f536f8dd08fb tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.164260 Jun 30 13:19:36.219196 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 559/1104] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:36 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:36.822105 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9666709e-d4dc-448a-809d-37cc5b656240 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:36.823648 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9666709e-d4dc-448a-809d-37cc5b656240 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:36.831567 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9666709e-d4dc-448a-809d-37cc5b656240 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:36.832390 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9666709e-d4dc-448a-809d-37cc5b656240 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:36.833390 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9666709e-d4dc-448a-809d-37cc5b656240 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:36.833822 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9666709e-d4dc-448a-809d-37cc5b656240 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:36.976302 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9666709e-d4dc-448a-809d-37cc5b656240 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:36.984424 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9666709e-d4dc-448a-809d-37cc5b656240 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.167288 Jun 30 13:19:36.985004 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 546/1105] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:36 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:37.237069 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a3e76f31-39c7-4082-a46f-eb552466f03d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:37.237885 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a3e76f31-39c7-4082-a46f-eb552466f03d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:37.245892 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a3e76f31-39c7-4082-a46f-eb552466f03d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:37.246367 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a3e76f31-39c7-4082-a46f-eb552466f03d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:37.247143 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a3e76f31-39c7-4082-a46f-eb552466f03d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:37.247575 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a3e76f31-39c7-4082-a46f-eb552466f03d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:37.389364 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a3e76f31-39c7-4082-a46f-eb552466f03d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:37.397975 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a3e76f31-39c7-4082-a46f-eb552466f03d tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.165155 Jun 30 13:19:37.399267 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 560/1106] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:37 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:38.001428 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-340502da-08dc-46d7-aa82-6814926899fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:38.002830 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-340502da-08dc-46d7-aa82-6814926899fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:38.009820 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340502da-08dc-46d7-aa82-6814926899fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:38.010270 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340502da-08dc-46d7-aa82-6814926899fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:38.011073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340502da-08dc-46d7-aa82-6814926899fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:38.011515 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-340502da-08dc-46d7-aa82-6814926899fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:38.215865 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-340502da-08dc-46d7-aa82-6814926899fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:38.224913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-340502da-08dc-46d7-aa82-6814926899fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.227435 Jun 30 13:19:38.225766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 547/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:37 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:38.415788 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ee9c09c0-2de2-47e4-ba08-6913b9d91ad1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:38.416444 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ee9c09c0-2de2-47e4-ba08-6913b9d91ad1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:38.423437 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ee9c09c0-2de2-47e4-ba08-6913b9d91ad1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:38.423869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ee9c09c0-2de2-47e4-ba08-6913b9d91ad1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:38.424640 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ee9c09c0-2de2-47e4-ba08-6913b9d91ad1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:38.425058 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ee9c09c0-2de2-47e4-ba08-6913b9d91ad1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:38.569285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-ee9c09c0-2de2-47e4-ba08-6913b9d91ad1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:38.578804 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ee9c09c0-2de2-47e4-ba08-6913b9d91ad1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.166955 Jun 30 13:19:38.579296 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 561/1108] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:38 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:39.242652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-5f2b7baf-48a6-4cae-9687-d1bbbe1877b3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:39.243304 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-5f2b7baf-48a6-4cae-9687-d1bbbe1877b3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:39.250699 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f2b7baf-48a6-4cae-9687-d1bbbe1877b3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:39.251480 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f2b7baf-48a6-4cae-9687-d1bbbe1877b3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:39.252339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f2b7baf-48a6-4cae-9687-d1bbbe1877b3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:39.252822 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-5f2b7baf-48a6-4cae-9687-d1bbbe1877b3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:39.400040 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-5f2b7baf-48a6-4cae-9687-d1bbbe1877b3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:39.408812 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-5f2b7baf-48a6-4cae-9687-d1bbbe1877b3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.170099 Jun 30 13:19:39.409386 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 548/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:39 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:39.597433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-31a72279-92d8-4615-8e5a-3aa9fa4aef2e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:39.598093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-31a72279-92d8-4615-8e5a-3aa9fa4aef2e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:39.604587 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-31a72279-92d8-4615-8e5a-3aa9fa4aef2e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:39.604984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-31a72279-92d8-4615-8e5a-3aa9fa4aef2e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:39.606089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-31a72279-92d8-4615-8e5a-3aa9fa4aef2e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:39.606550 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-31a72279-92d8-4615-8e5a-3aa9fa4aef2e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:39.752778 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-31a72279-92d8-4615-8e5a-3aa9fa4aef2e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:39.761925 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-31a72279-92d8-4615-8e5a-3aa9fa4aef2e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.169425 Jun 30 13:19:39.762922 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 562/1110] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:39 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:40.427310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-205b4199-4712-4a5a-8b8b-ad34a4cd87be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:40.427976 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-205b4199-4712-4a5a-8b8b-ad34a4cd87be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:40.434604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-205b4199-4712-4a5a-8b8b-ad34a4cd87be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:40.435045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-205b4199-4712-4a5a-8b8b-ad34a4cd87be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:40.436933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-205b4199-4712-4a5a-8b8b-ad34a4cd87be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:40.437361 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-205b4199-4712-4a5a-8b8b-ad34a4cd87be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:40.610296 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-205b4199-4712-4a5a-8b8b-ad34a4cd87be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:40.618685 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-205b4199-4712-4a5a-8b8b-ad34a4cd87be tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.196350 Jun 30 13:19:40.619270 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 549/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:40 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:40.779333 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5e3eff8a-7914-4ff8-9a9c-cf681b60891f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:40.780039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-5e3eff8a-7914-4ff8-9a9c-cf681b60891f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:40.788066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5e3eff8a-7914-4ff8-9a9c-cf681b60891f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:40.788590 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5e3eff8a-7914-4ff8-9a9c-cf681b60891f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:40.789365 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5e3eff8a-7914-4ff8-9a9c-cf681b60891f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:40.789785 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-5e3eff8a-7914-4ff8-9a9c-cf681b60891f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:40.928296 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-5e3eff8a-7914-4ff8-9a9c-cf681b60891f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:40.938262 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5e3eff8a-7914-4ff8-9a9c-cf681b60891f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.162903 Jun 30 13:19:40.938890 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 563/1112] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:40 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:41.640244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-0e7514da-b176-4019-abba-e8bc0ec3316b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:41.641249 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-0e7514da-b176-4019-abba-e8bc0ec3316b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:41.644360 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=4 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:41.645425 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=12 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:41.658477 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e7514da-b176-4019-abba-e8bc0ec3316b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:41.658964 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e7514da-b176-4019-abba-e8bc0ec3316b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:41.660181 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e7514da-b176-4019-abba-e8bc0ec3316b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:41.660794 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-0e7514da-b176-4019-abba-e8bc0ec3316b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:41.810466 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-0e7514da-b176-4019-abba-e8bc0ec3316b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:41.822463 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-0e7514da-b176-4019-abba-e8bc0ec3316b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.188483 Jun 30 13:19:41.823345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 550/1113] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:41 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:41.960639 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-877c736d-406c-455d-a56d-02377488a014 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:41.961637 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-877c736d-406c-455d-a56d-02377488a014 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:41.964980 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=8 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:41.975070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-877c736d-406c-455d-a56d-02377488a014 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:41.975808 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-877c736d-406c-455d-a56d-02377488a014 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:41.977070 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-877c736d-406c-455d-a56d-02377488a014 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:41.977789 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-877c736d-406c-455d-a56d-02377488a014 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:42.125213 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-877c736d-406c-455d-a56d-02377488a014 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:42.133542 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-877c736d-406c-455d-a56d-02377488a014 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.179877 Jun 30 13:19:42.134080 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 564/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:41 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:42.846766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-e3245df4-1ba6-412d-bfc3-b9723fddba67 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:42.847673 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-e3245df4-1ba6-412d-bfc3-b9723fddba67 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:42.858659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3245df4-1ba6-412d-bfc3-b9723fddba67 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:42.859428 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3245df4-1ba6-412d-bfc3-b9723fddba67 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:42.860629 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3245df4-1ba6-412d-bfc3-b9723fddba67 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:42.861057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-e3245df4-1ba6-412d-bfc3-b9723fddba67 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:42.994706 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-e3245df4-1ba6-412d-bfc3-b9723fddba67 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:43.004626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-e3245df4-1ba6-412d-bfc3-b9723fddba67 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.165345 Jun 30 13:19:43.005199 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 551/1115] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:42 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:43.155277 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-89a21868-d16f-4e7b-8779-fcbd1a84913c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:43.156081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-89a21868-d16f-4e7b-8779-fcbd1a84913c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:43.163646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-89a21868-d16f-4e7b-8779-fcbd1a84913c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:43.164094 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-89a21868-d16f-4e7b-8779-fcbd1a84913c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:43.164839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-89a21868-d16f-4e7b-8779-fcbd1a84913c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:43.165275 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-89a21868-d16f-4e7b-8779-fcbd1a84913c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:43.306107 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-89a21868-d16f-4e7b-8779-fcbd1a84913c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:43.316235 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-89a21868-d16f-4e7b-8779-fcbd1a84913c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.165881 Jun 30 13:19:43.316813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 565/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:43 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:44.023570 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-602a7897-c4c0-43df-aefb-558472a0f2c7 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:44.024474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-602a7897-c4c0-43df-aefb-558472a0f2c7 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:44.032337 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-602a7897-c4c0-43df-aefb-558472a0f2c7 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:44.033345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-602a7897-c4c0-43df-aefb-558472a0f2c7 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:44.035196 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-602a7897-c4c0-43df-aefb-558472a0f2c7 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:44.035897 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-602a7897-c4c0-43df-aefb-558472a0f2c7 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:44.333476 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-244ee75a-8e40-4671-92f3-be684a51aca7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:44.334109 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-244ee75a-8e40-4671-92f3-be684a51aca7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:44.341039 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-244ee75a-8e40-4671-92f3-be684a51aca7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:44.341479 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-244ee75a-8e40-4671-92f3-be684a51aca7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:44.342242 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-244ee75a-8e40-4671-92f3-be684a51aca7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:44.342701 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-244ee75a-8e40-4671-92f3-be684a51aca7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:44.475871 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-244ee75a-8e40-4671-92f3-be684a51aca7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:44.483736 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-244ee75a-8e40-4671-92f3-be684a51aca7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.154560 Jun 30 13:19:44.484313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 566/1117] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:44 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:44.498116 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-602a7897-c4c0-43df-aefb-558472a0f2c7 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:44.506031 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-602a7897-c4c0-43df-aefb-558472a0f2c7 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.487418 Jun 30 13:19:44.506667 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 552/1118] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:44 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:45.032888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-c4379d5b-b8bf-4f73-87ea-a997e2443b22 req-520d4bab-99dc-4e42-83b0-94b5a9c03638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53291237-b1e1-4f2c-a545-4520559239f3", "tag": "3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:45.052528 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-c4379d5b-b8bf-4f73-87ea-a997e2443b22 req-520d4bab-99dc-4e42-83b0-94b5a9c03638 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:45.052887 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-c4379d5b-b8bf-4f73-87ea-a997e2443b22 req-520d4bab-99dc-4e42-83b0-94b5a9c03638 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:45.065392 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-c4379d5b-b8bf-4f73-87ea-a997e2443b22 req-520d4bab-99dc-4e42-83b0-94b5a9c03638 service nova] Creating event network-changed:3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 for instance 53291237-b1e1-4f2c-a545-4520559239f3 on hv-cinder-81268 Jun 30 13:19:45.070500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-c4379d5b-b8bf-4f73-87ea-a997e2443b22 req-520d4bab-99dc-4e42-83b0-94b5a9c03638 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041375 Jun 30 13:19:45.071107 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 567/1119] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:45.501851 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9ed41f18-ecff-4f43-a435-8c9246206151 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:45.502491 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9ed41f18-ecff-4f43-a435-8c9246206151 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:45.509275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ed41f18-ecff-4f43-a435-8c9246206151 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:45.509729 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ed41f18-ecff-4f43-a435-8c9246206151 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:45.510530 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ed41f18-ecff-4f43-a435-8c9246206151 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:45.510960 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9ed41f18-ecff-4f43-a435-8c9246206151 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:45.525016 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-4b4bf01d-a25c-40c5-b068-fe07cc7757fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:45.525779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-4b4bf01d-a25c-40c5-b068-fe07cc7757fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:45.532925 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4b4bf01d-a25c-40c5-b068-fe07cc7757fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:45.533444 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4b4bf01d-a25c-40c5-b068-fe07cc7757fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:45.534285 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4b4bf01d-a25c-40c5-b068-fe07cc7757fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:45.534806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-4b4bf01d-a25c-40c5-b068-fe07cc7757fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:45.671728 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-4b4bf01d-a25c-40c5-b068-fe07cc7757fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:45.679694 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-4b4bf01d-a25c-40c5-b068-fe07cc7757fe tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1315 microversion: 2.1 time: 0.159850 Jun 30 13:19:45.681561 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 568/1120] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:45 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:45.707590 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9ed41f18-ecff-4f43-a435-8c9246206151 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:45.717357 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9ed41f18-ecff-4f43-a435-8c9246206151 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.220016 Jun 30 13:19:45.718916 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 553/1121] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:45 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:46.698727 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e7d8ec34-b94b-4f93-aed4-17e56125ab96 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:46.699336 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e7d8ec34-b94b-4f93-aed4-17e56125ab96 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:46.706043 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e7d8ec34-b94b-4f93-aed4-17e56125ab96 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:46.706529 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e7d8ec34-b94b-4f93-aed4-17e56125ab96 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:46.707286 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e7d8ec34-b94b-4f93-aed4-17e56125ab96 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:46.707713 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e7d8ec34-b94b-4f93-aed4-17e56125ab96 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:46.735686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-163c8d21-4ceb-4d82-ad1b-96ecfb7b3980 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:46.736282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-163c8d21-4ceb-4d82-ad1b-96ecfb7b3980 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:46.743513 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-163c8d21-4ceb-4d82-ad1b-96ecfb7b3980 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:46.743947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-163c8d21-4ceb-4d82-ad1b-96ecfb7b3980 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:46.744891 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-163c8d21-4ceb-4d82-ad1b-96ecfb7b3980 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:46.745310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-163c8d21-4ceb-4d82-ad1b-96ecfb7b3980 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:46.838734 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e7d8ec34-b94b-4f93-aed4-17e56125ab96 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:46.847090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e7d8ec34-b94b-4f93-aed4-17e56125ab96 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1464 microversion: 2.1 time: 0.152353 Jun 30 13:19:46.847636 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 569/1122] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:46 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:46.880201 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-163c8d21-4ceb-4d82-ad1b-96ecfb7b3980 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:46.887822 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-163c8d21-4ceb-4d82-ad1b-96ecfb7b3980 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.156344 Jun 30 13:19:46.887999 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8cb57b53-c07e-4962-aa78-101d5f0580b8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:46.888415 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 554/1123] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:46 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:46.888624 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8cb57b53-c07e-4962-aa78-101d5f0580b8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:46.895024 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8cb57b53-c07e-4962-aa78-101d5f0580b8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:46.895501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8cb57b53-c07e-4962-aa78-101d5f0580b8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:46.896370 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8cb57b53-c07e-4962-aa78-101d5f0580b8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:46.896919 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8cb57b53-c07e-4962-aa78-101d5f0580b8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:46.923878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8cb57b53-c07e-4962-aa78-101d5f0580b8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:19:46.977931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:47.009798 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8cb57b53-c07e-4962-aa78-101d5f0580b8 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "DELETE /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 204 len: 0 microversion: 2.1 time: 0.125584 Jun 30 13:19:47.010440 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 570/1124] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:19:46 2022] DELETE /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:19:47.019149 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9d3fb0e8-d154-4505-b034-2489788dd1ee tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:47.019762 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9d3fb0e8-d154-4505-b034-2489788dd1ee tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:47.026050 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d3fb0e8-d154-4505-b034-2489788dd1ee tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:47.026535 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d3fb0e8-d154-4505-b034-2489788dd1ee tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:47.027290 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d3fb0e8-d154-4505-b034-2489788dd1ee tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:47.027716 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9d3fb0e8-d154-4505-b034-2489788dd1ee tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:47.159419 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9d3fb0e8-d154-4505-b034-2489788dd1ee tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:47.167305 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9d3fb0e8-d154-4505-b034-2489788dd1ee tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1470 microversion: 2.1 time: 0.152512 Jun 30 13:19:47.167847 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 555/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:47 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:47.905996 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-a16dc00e-04cc-42bb-bf2d-0a2c1e1f55bd tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:47.906667 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-a16dc00e-04cc-42bb-bf2d-0a2c1e1f55bd tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:47.913645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a16dc00e-04cc-42bb-bf2d-0a2c1e1f55bd tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:47.914088 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a16dc00e-04cc-42bb-bf2d-0a2c1e1f55bd tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:47.914872 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a16dc00e-04cc-42bb-bf2d-0a2c1e1f55bd tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:47.915304 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-a16dc00e-04cc-42bb-bf2d-0a2c1e1f55bd tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:48.057902 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-a16dc00e-04cc-42bb-bf2d-0a2c1e1f55bd tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:48.069803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-a16dc00e-04cc-42bb-bf2d-0a2c1e1f55bd tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.168078 Jun 30 13:19:48.070587 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 571/1126] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:47 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:48.186910 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-22ccb4bb-ae3c-4639-a0a2-e9ea612344f3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:48.187682 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-22ccb4bb-ae3c-4639-a0a2-e9ea612344f3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:48.195460 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22ccb4bb-ae3c-4639-a0a2-e9ea612344f3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:48.195908 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22ccb4bb-ae3c-4639-a0a2-e9ea612344f3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:48.196672 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22ccb4bb-ae3c-4639-a0a2-e9ea612344f3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:48.197102 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-22ccb4bb-ae3c-4639-a0a2-e9ea612344f3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:48.335444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-22ccb4bb-ae3c-4639-a0a2-e9ea612344f3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:48.343433 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-22ccb4bb-ae3c-4639-a0a2-e9ea612344f3 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1470 microversion: 2.1 time: 0.161422 Jun 30 13:19:48.344049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 556/1127] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:48 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:49.086970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-53d9dcb3-a035-4213-a29f-cdd4eaee30b5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:49.087557 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-53d9dcb3-a035-4213-a29f-cdd4eaee30b5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:49.094596 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-53d9dcb3-a035-4213-a29f-cdd4eaee30b5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:49.095042 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-53d9dcb3-a035-4213-a29f-cdd4eaee30b5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:49.095790 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-53d9dcb3-a035-4213-a29f-cdd4eaee30b5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:49.096209 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-53d9dcb3-a035-4213-a29f-cdd4eaee30b5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:49.234745 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-53d9dcb3-a035-4213-a29f-cdd4eaee30b5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:49.242608 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-53d9dcb3-a035-4213-a29f-cdd4eaee30b5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.159581 Jun 30 13:19:49.243161 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 572/1128] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:49 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:49.365669 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-9841b6ff-d772-406f-aeb3-3816cd5b403b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:49.366497 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-9841b6ff-d772-406f-aeb3-3816cd5b403b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:49.374769 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9841b6ff-d772-406f-aeb3-3816cd5b403b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:49.375315 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9841b6ff-d772-406f-aeb3-3816cd5b403b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:49.376214 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9841b6ff-d772-406f-aeb3-3816cd5b403b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:49.376781 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-9841b6ff-d772-406f-aeb3-3816cd5b403b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:49.534659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-9841b6ff-d772-406f-aeb3-3816cd5b403b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:49.542647 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-9841b6ff-d772-406f-aeb3-3816cd5b403b tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1470 microversion: 2.1 time: 0.184046 Jun 30 13:19:49.543212 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 557/1129] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:49 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:50.263685 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8d36c52e-489f-4309-a72a-5afc6026b6a5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:50.264618 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8d36c52e-489f-4309-a72a-5afc6026b6a5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:50.276383 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8d36c52e-489f-4309-a72a-5afc6026b6a5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:50.277124 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8d36c52e-489f-4309-a72a-5afc6026b6a5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:50.278410 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8d36c52e-489f-4309-a72a-5afc6026b6a5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:50.279193 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8d36c52e-489f-4309-a72a-5afc6026b6a5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:50.413357 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8d36c52e-489f-4309-a72a-5afc6026b6a5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:50.421050 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8d36c52e-489f-4309-a72a-5afc6026b6a5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.163969 Jun 30 13:19:50.421617 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 573/1130] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:50 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:50.559594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ca70e620-e8bb-4f28-a021-3fa00e739a9c tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:50.560205 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ca70e620-e8bb-4f28-a021-3fa00e739a9c tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:50.567122 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca70e620-e8bb-4f28-a021-3fa00e739a9c tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:50.567615 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca70e620-e8bb-4f28-a021-3fa00e739a9c tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:50.568304 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca70e620-e8bb-4f28-a021-3fa00e739a9c tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:50.568758 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ca70e620-e8bb-4f28-a021-3fa00e739a9c tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:50.571506 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=100 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:19:50.791166 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ca70e620-e8bb-4f28-a021-3fa00e739a9c tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e85350136a84c7e866f3246070e58f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afad84e1a04d0683cc754a62c51609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:50.815076 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ca70e620-e8bb-4f28-a021-3fa00e739a9c tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 200 len: 1470 microversion: 2.1 time: 0.259365 Jun 30 13:19:50.816034 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 558/1131] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:50 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:51.051977 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-d6cceb35-6bb5-406f-bc92-f6d099bc6a5d req-0386a582-a828-4cb8-b9ce-3449989b4a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "732da64f-9401-49ec-b675-4c173f23652a", "name": "network-vif-deleted", "tag": "dff194e8-1419-4520-9e12-9a7ae73e57aa"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:51.060329 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-d6cceb35-6bb5-406f-bc92-f6d099bc6a5d req-0386a582-a828-4cb8-b9ce-3449989b4a7f service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:51.061073 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-d6cceb35-6bb5-406f-bc92-f6d099bc6a5d req-0386a582-a828-4cb8-b9ce-3449989b4a7f service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:51.073111 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-d6cceb35-6bb5-406f-bc92-f6d099bc6a5d req-0386a582-a828-4cb8-b9ce-3449989b4a7f service nova] Creating event network-vif-deleted:dff194e8-1419-4520-9e12-9a7ae73e57aa for instance 732da64f-9401-49ec-b675-4c173f23652a on hv-cinder-81268 Jun 30 13:19:51.078240 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-d6cceb35-6bb5-406f-bc92-f6d099bc6a5d req-0386a582-a828-4cb8-b9ce-3449989b4a7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030272 Jun 30 13:19:51.079265 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 574/1132] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:51.438467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7aaf9c5-ed7b-47a5-b904-366b01bf496b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:51.439075 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7aaf9c5-ed7b-47a5-b904-366b01bf496b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:51.445510 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7aaf9c5-ed7b-47a5-b904-366b01bf496b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:51.445902 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7aaf9c5-ed7b-47a5-b904-366b01bf496b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:51.446692 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7aaf9c5-ed7b-47a5-b904-366b01bf496b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:51.447121 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7aaf9c5-ed7b-47a5-b904-366b01bf496b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:51.581478 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7aaf9c5-ed7b-47a5-b904-366b01bf496b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:51.589443 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7aaf9c5-ed7b-47a5-b904-366b01bf496b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.154927 Jun 30 13:19:51.589985 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 559/1133] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:51 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:51.778095 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-20e0b492-809a-411b-ab8d-64a39079be37 req-9efb7a78-3675-44f8-b429-ec0e35a7da5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53291237-b1e1-4f2c-a545-4520559239f3", "name": "network-vif-plugged", "status": "completed", "tag": "3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:51.791095 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-20e0b492-809a-411b-ab8d-64a39079be37 req-9efb7a78-3675-44f8-b429-ec0e35a7da5f service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:51.791943 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-20e0b492-809a-411b-ab8d-64a39079be37 req-9efb7a78-3675-44f8-b429-ec0e35a7da5f service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:51.804270 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-20e0b492-809a-411b-ab8d-64a39079be37 req-9efb7a78-3675-44f8-b429-ec0e35a7da5f service nova] Creating event network-vif-plugged:3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 for instance 53291237-b1e1-4f2c-a545-4520559239f3 on hv-cinder-81268 Jun 30 13:19:51.809359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-20e0b492-809a-411b-ab8d-64a39079be37 req-9efb7a78-3675-44f8-b429-ec0e35a7da5f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037413 Jun 30 13:19:51.809963 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 575/1134] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:51.834339 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:51.835267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] [instance: 732da64f-9401-49ec-b675-4c173f23652a] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:51.842756 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:51.843895 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:51.851880 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:51.852473 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:51.867823 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] HTTP exception thrown: Instance 732da64f-9401-49ec-b675-4c173f23652a could not be found. Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Request method failure captured: Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a HTTP/1.1 Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaLaoI5gAMQY9Hcl6nROjfdUYuY_jJlWY718yyAm69eDlWrXg683ZXVnKnxn-9roj6LuiBGEoTJ0o2wbIQ4P2Nrmkpk47Rl2OOwSmsKytY57kyqXvT754LdttlFOuZ6cv5dwvXoqeSPvwguL9SuQtNsd1YEeWnMJhF2Hd7WZK1jpyRw Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 77afad84e1a04d0683cc754a62c51609 Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-VolumesNegativeTest-1266817066 Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:19:51.869538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/77afad84e1a04d0683cc754a62c51609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/77afad84e1a04d0683cc754a62c51609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_77afad84e1a04d0683cc754a62c51609"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/77afad84e1a04d0683cc754a62c51609"}]}] Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-VolumesNegativeTest-1266817066 Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 77afad84e1a04d0683cc754a62c51609 Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-VolumesNegativeTest-1266817066 Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-VolumesNegativeTest-1266817066-project Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 5e85350136a84c7e866f3246070e58f8 Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-VolumesNegativeTest-1266817066-project Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 732da64f-9401-49ec-b675-4c173f23652a could not be found. Jun 30 13:19:51.871287 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '732da64f-9401-49ec-b675-4c173f23652a'} Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 732da64f-9401-49ec-b675-4c173f23652a could not be found. Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:19:51.873226 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 732da64f-9401-49ec-b675-4c173f23652a could not be found. Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 732da64f-9401-49ec-b675-4c173f23652a could not be found. Jun 30 13:19:51.875512 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:19:51.876957 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] Returning 404 to user: Instance 732da64f-9401-49ec-b675-4c173f23652a could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:19:51.876957 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ae74c40e-ab09-4726-9ec7-a16f98d9e3c9 tempest-VolumesNegativeTest-1266817066 tempest-VolumesNegativeTest-1266817066-project] 10.222.0.49 "GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a" status: 404 len: 111 microversion: 2.1 time: 0.042004 Jun 30 13:19:51.876957 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 560/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:51 2022] GET /compute/v2.1/servers/732da64f-9401-49ec-b675-4c173f23652a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:19:52.612642 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-71ea8cca-ee4c-4169-aa9d-ca7ffb0d0ab7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:52.613334 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-71ea8cca-ee4c-4169-aa9d-ca7ffb0d0ab7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:52.619826 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-71ea8cca-ee4c-4169-aa9d-ca7ffb0d0ab7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:52.620263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-71ea8cca-ee4c-4169-aa9d-ca7ffb0d0ab7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:52.621023 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-71ea8cca-ee4c-4169-aa9d-ca7ffb0d0ab7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:52.621444 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-71ea8cca-ee4c-4169-aa9d-ca7ffb0d0ab7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:52.764351 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-71ea8cca-ee4c-4169-aa9d-ca7ffb0d0ab7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:52.775567 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-71ea8cca-ee4c-4169-aa9d-ca7ffb0d0ab7 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.167300 Jun 30 13:19:52.776144 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 576/1136] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:52 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 13:19:53.792882 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-ec5b3d18-ef41-4b20-a24f-a64a3a5c3159 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:53.794129 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-ec5b3d18-ef41-4b20-a24f-a64a3a5c3159 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:53.800703 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b3d18-ef41-4b20-a24f-a64a3a5c3159 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:53.801147 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b3d18-ef41-4b20-a24f-a64a3a5c3159 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:53.801905 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b3d18-ef41-4b20-a24f-a64a3a5c3159 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:53.802474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-ec5b3d18-ef41-4b20-a24f-a64a3a5c3159 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:53.938077 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-ec5b3d18-ef41-4b20-a24f-a64a3a5c3159 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:53.946024 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-ec5b3d18-ef41-4b20-a24f-a64a3a5c3159 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1358 microversion: 2.1 time: 0.157517 Jun 30 13:19:53.946692 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 561/1137] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:53 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:54.964821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-bab2517d-4530-4185-96a8-7eb8920327a9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:54.965369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-bab2517d-4530-4185-96a8-7eb8920327a9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:54.974672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bab2517d-4530-4185-96a8-7eb8920327a9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:54.975179 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bab2517d-4530-4185-96a8-7eb8920327a9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:54.976003 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bab2517d-4530-4185-96a8-7eb8920327a9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:54.976430 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-bab2517d-4530-4185-96a8-7eb8920327a9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:55.111189 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-bab2517d-4530-4185-96a8-7eb8920327a9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:55.120399 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-bab2517d-4530-4185-96a8-7eb8920327a9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1548 microversion: 2.1 time: 0.161749 Jun 30 13:19:55.120984 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 577/1138] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:54 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:55.142814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-41be0a08-909b-45fa-8b5e-2697dc062b3c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:55.143423 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-41be0a08-909b-45fa-8b5e-2697dc062b3c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:55.150987 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41be0a08-909b-45fa-8b5e-2697dc062b3c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:55.151437 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41be0a08-909b-45fa-8b5e-2697dc062b3c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:55.152206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41be0a08-909b-45fa-8b5e-2697dc062b3c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:55.152643 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-41be0a08-909b-45fa-8b5e-2697dc062b3c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:55.297316 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-41be0a08-909b-45fa-8b5e-2697dc062b3c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:55.306067 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-41be0a08-909b-45fa-8b5e-2697dc062b3c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1548 microversion: 2.1 time: 0.167180 Jun 30 13:19:55.306679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 562/1139] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:55 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:55.324999 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:55.330275 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:55.331431 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Searching by: {'deleted': False, 'project_id': '810dd4c41fca4b11938e32d08221c9b8'} {{(pid=117826) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 13:19:55.339405 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:55.339833 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:55.340641 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:55.341084 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:55.430381 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.multi_cell_list [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117826) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 13:19:55.522287 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-57253c9b-9b87-4842-978c-91c8b3e5c583 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203381 Jun 30 13:19:55.522810 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 578/1140] 10.222.0.49 () {58 vars in 1124 bytes} [Thu Jun 30 13:19:55 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:19:55.535191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8cd4e0ca-93bf-4ff5-b522-503463652d80 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:19:55.536028 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8cd4e0ca-93bf-4ff5-b522-503463652d80 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:55.542568 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cd4e0ca-93bf-4ff5-b522-503463652d80 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:55.543011 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cd4e0ca-93bf-4ff5-b522-503463652d80 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:55.543764 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cd4e0ca-93bf-4ff5-b522-503463652d80 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:55.544190 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8cd4e0ca-93bf-4ff5-b522-503463652d80 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:55.681880 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8cd4e0ca-93bf-4ff5-b522-503463652d80 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:19:55.689852 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8cd4e0ca-93bf-4ff5-b522-503463652d80 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1548 microversion: 2.1 time: 0.160375 Jun 30 13:19:55.690444 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 563/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:19:55 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:19:57.244697 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b10a2926-bab8-4ae9-8ec5-d73ddb92075a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07726e32-1893-4c06-9c00-59a92c5c96da"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:19:57.246045 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b10a2926-bab8-4ae9-8ec5-d73ddb92075a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:19:57.254772 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b10a2926-bab8-4ae9-8ec5-d73ddb92075a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:57.256905 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b10a2926-bab8-4ae9-8ec5-d73ddb92075a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:57.256905 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b10a2926-bab8-4ae9-8ec5-d73ddb92075a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:19:57.256905 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b10a2926-bab8-4ae9-8ec5-d73ddb92075a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:19:57.702655 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b10a2926-bab8-4ae9-8ec5-d73ddb92075a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "POST /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462371 Jun 30 13:19:57.703281 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 579/1142] 10.222.0.49 () {60 vars in 1322 bytes} [Thu Jun 30 13:19:57 2022] POST /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments => generated 194 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:20:05.348100 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-50099ae9-53cf-4444-8b53-46771994b14b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:20:05.348763 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-50099ae9-53cf-4444-8b53-46771994b14b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:20:05.352635 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:05.360586 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50099ae9-53cf-4444-8b53-46771994b14b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:20:05.361182 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50099ae9-53cf-4444-8b53-46771994b14b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:20:05.362361 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50099ae9-53cf-4444-8b53-46771994b14b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:20:05.362938 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-50099ae9-53cf-4444-8b53-46771994b14b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:20:05.499867 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-50099ae9-53cf-4444-8b53-46771994b14b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:20:05.508195 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-50099ae9-53cf-4444-8b53-46771994b14b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1594 microversion: 2.1 time: 0.166871 Jun 30 13:20:05.508772 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 564/1143] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:20:05 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1594 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:20:07.359682 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:07.360401 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:07.364597 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-b1a4a3c3-d3c2-4eaa-9128-529012348170 req-ed0e4b52-1eb1-4f8a-b988-f74ad3ac6bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53291237-b1e1-4f2c-a545-4520559239f3", "tag": "3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:20:07.375127 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-b1a4a3c3-d3c2-4eaa-9128-529012348170 req-ed0e4b52-1eb1-4f8a-b988-f74ad3ac6bc6 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:20:07.375543 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-b1a4a3c3-d3c2-4eaa-9128-529012348170 req-ed0e4b52-1eb1-4f8a-b988-f74ad3ac6bc6 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:20:07.388247 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-b1a4a3c3-d3c2-4eaa-9128-529012348170 req-ed0e4b52-1eb1-4f8a-b988-f74ad3ac6bc6 service nova] Creating event network-changed:3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 for instance 53291237-b1e1-4f2c-a545-4520559239f3 on hv-cinder-81268 Jun 30 13:20:07.393878 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-b1a4a3c3-d3c2-4eaa-9128-529012348170 req-ed0e4b52-1eb1-4f8a-b988-f74ad3ac6bc6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035731 Jun 30 13:20:07.394516 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 580/1144] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:20:08.645103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-66302f18-1a58-487d-bd4b-0c8eff394547 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1393334742"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:20:08.645678 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-66302f18-1a58-487d-bd4b-0c8eff394547 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:20:08.654933 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66302f18-1a58-487d-bd4b-0c8eff394547 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:20:08.655410 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66302f18-1a58-487d-bd4b-0c8eff394547 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:20:08.656189 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66302f18-1a58-487d-bd4b-0c8eff394547 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:20:08.656654 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-66302f18-1a58-487d-bd4b-0c8eff394547 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:20:08.787906 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.network.security_group_api [None req-66302f18-1a58-487d-bd4b-0c8eff394547 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Adding security group be784a43-cbb6-4f42-ae87-b9dcc0e52e56 to port 3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 Jun 30 13:20:09.199321 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-66302f18-1a58-487d-bd4b-0c8eff394547 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "POST /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/action" status: 202 len: 0 microversion: 2.1 time: 0.560354 Jun 30 13:20:09.200224 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 565/1145] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:20:08 2022] POST /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:20:09.214839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e510ae03-5d7b-4713-8bb5-889b27fd7865 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:20:09.215616 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e510ae03-5d7b-4713-8bb5-889b27fd7865 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:20:09.220726 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-dc7935da-9413-4b23-adaa-dd143ca1d466 req-585c598a-d8f5-47ee-8b34-aa52c96aee85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53291237-b1e1-4f2c-a545-4520559239f3", "tag": "3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:20:09.229706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e510ae03-5d7b-4713-8bb5-889b27fd7865 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:20:09.232517 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e510ae03-5d7b-4713-8bb5-889b27fd7865 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:20:09.233494 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e510ae03-5d7b-4713-8bb5-889b27fd7865 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:20:09.233916 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e510ae03-5d7b-4713-8bb5-889b27fd7865 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:20:09.241163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-dc7935da-9413-4b23-adaa-dd143ca1d466 req-585c598a-d8f5-47ee-8b34-aa52c96aee85 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:20:09.241592 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-dc7935da-9413-4b23-adaa-dd143ca1d466 req-585c598a-d8f5-47ee-8b34-aa52c96aee85 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:20:09.263980 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-dc7935da-9413-4b23-adaa-dd143ca1d466 req-585c598a-d8f5-47ee-8b34-aa52c96aee85 service nova] Creating event network-changed:3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 for instance 53291237-b1e1-4f2c-a545-4520559239f3 on hv-cinder-81268 Jun 30 13:20:09.273254 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-dc7935da-9413-4b23-adaa-dd143ca1d466 req-585c598a-d8f5-47ee-8b34-aa52c96aee85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064056 Jun 30 13:20:09.273858 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 566/1146] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:20:09.443342 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e510ae03-5d7b-4713-8bb5-889b27fd7865 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:20:09.452420 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e510ae03-5d7b-4713-8bb5-889b27fd7865 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1760 microversion: 2.1 time: 0.247855 Jun 30 13:20:09.453439 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 581/1147] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:20:09 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1760 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:03.152485 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:21:03.153847 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Thu Jun 30 13:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:21:09.917079 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=5 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:09.917981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=43 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:09.923551 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-4edbec58-7cff-4029-bbfd-c65e88c3cac9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:21:09.924827 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-4edbec58-7cff-4029-bbfd-c65e88c3cac9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:09.933328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4edbec58-7cff-4029-bbfd-c65e88c3cac9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:09.933766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4edbec58-7cff-4029-bbfd-c65e88c3cac9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:09.934557 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4edbec58-7cff-4029-bbfd-c65e88c3cac9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:09.934981 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-4edbec58-7cff-4029-bbfd-c65e88c3cac9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:10.023536 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-4edbec58-7cff-4029-bbfd-c65e88c3cac9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "POST /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/action" status: 202 len: 0 microversion: 2.1 time: 0.108817 Jun 30 13:21:10.024168 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 567/1148] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:21:09 2022] POST /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:21:10.031411 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=4 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:10.032197 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=61,nova_cell1:UPDATE=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:10.036106 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-67e67f3b-6409-4305-a660-825d9a690964 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:10.036706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-67e67f3b-6409-4305-a660-825d9a690964 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:10.044815 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67e67f3b-6409-4305-a660-825d9a690964 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:10.045271 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67e67f3b-6409-4305-a660-825d9a690964 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:10.046030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67e67f3b-6409-4305-a660-825d9a690964 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:10.046502 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-67e67f3b-6409-4305-a660-825d9a690964 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:10.330500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-67e67f3b-6409-4305-a660-825d9a690964 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:10.338738 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-67e67f3b-6409-4305-a660-825d9a690964 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1752 microversion: 2.1 time: 0.309608 Jun 30 13:21:10.339356 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 582/1149] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:10 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1752 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:11.361905 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-605d552e-c431-4bff-a990-c0a0db9393f1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:11.363071 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-605d552e-c431-4bff-a990-c0a0db9393f1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:11.372279 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-605d552e-c431-4bff-a990-c0a0db9393f1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:11.372715 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-605d552e-c431-4bff-a990-c0a0db9393f1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:11.373467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-605d552e-c431-4bff-a990-c0a0db9393f1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:11.373889 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-605d552e-c431-4bff-a990-c0a0db9393f1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:11.585945 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-605d552e-c431-4bff-a990-c0a0db9393f1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:11.597389 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-605d552e-c431-4bff-a990-c0a0db9393f1 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.242676 Jun 30 13:21:11.598132 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 568/1150] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:11 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:12.619594 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-59ae7f45-251c-47cb-9682-ee4460cb8bf5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:12.620237 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-59ae7f45-251c-47cb-9682-ee4460cb8bf5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:12.626672 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59ae7f45-251c-47cb-9682-ee4460cb8bf5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:12.627120 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59ae7f45-251c-47cb-9682-ee4460cb8bf5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:12.627869 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59ae7f45-251c-47cb-9682-ee4460cb8bf5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:12.628289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-59ae7f45-251c-47cb-9682-ee4460cb8bf5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:12.778903 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-59ae7f45-251c-47cb-9682-ee4460cb8bf5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:12.787622 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-59ae7f45-251c-47cb-9682-ee4460cb8bf5 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.174722 Jun 30 13:21:12.788194 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 583/1151] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:12 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:13.807674 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8d4b561f-c7dc-4bf7-8838-dc5dca14d390 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:13.808460 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8d4b561f-c7dc-4bf7-8838-dc5dca14d390 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:13.817378 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d4b561f-c7dc-4bf7-8838-dc5dca14d390 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:13.817960 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d4b561f-c7dc-4bf7-8838-dc5dca14d390 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:13.818998 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d4b561f-c7dc-4bf7-8838-dc5dca14d390 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:13.819560 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8d4b561f-c7dc-4bf7-8838-dc5dca14d390 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:13.968529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-8d4b561f-c7dc-4bf7-8838-dc5dca14d390 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:13.980569 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8d4b561f-c7dc-4bf7-8838-dc5dca14d390 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.178165 Jun 30 13:21:13.981136 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 569/1152] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:13 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:15.001149 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8bc52d0d-e817-42ea-a1bc-cb6cbc46ea3f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:15.001740 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8bc52d0d-e817-42ea-a1bc-cb6cbc46ea3f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:15.011257 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8bc52d0d-e817-42ea-a1bc-cb6cbc46ea3f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:15.011825 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8bc52d0d-e817-42ea-a1bc-cb6cbc46ea3f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:15.012968 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8bc52d0d-e817-42ea-a1bc-cb6cbc46ea3f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:15.013436 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8bc52d0d-e817-42ea-a1bc-cb6cbc46ea3f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:15.160868 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8bc52d0d-e817-42ea-a1bc-cb6cbc46ea3f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:15.169877 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8bc52d0d-e817-42ea-a1bc-cb6cbc46ea3f tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.175264 Jun 30 13:21:15.170468 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 584/1153] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:14 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:16.188259 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-25a0c107-2dd1-4db8-9ba2-c7ccd3f866c2 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:16.188920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-25a0c107-2dd1-4db8-9ba2-c7ccd3f866c2 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:16.196331 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25a0c107-2dd1-4db8-9ba2-c7ccd3f866c2 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:16.196825 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25a0c107-2dd1-4db8-9ba2-c7ccd3f866c2 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:16.197670 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25a0c107-2dd1-4db8-9ba2-c7ccd3f866c2 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:16.198228 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-25a0c107-2dd1-4db8-9ba2-c7ccd3f866c2 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:16.347908 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-25a0c107-2dd1-4db8-9ba2-c7ccd3f866c2 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:16.356649 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-25a0c107-2dd1-4db8-9ba2-c7ccd3f866c2 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.172797 Jun 30 13:21:16.357232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 570/1154] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:16 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:17.382839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8e8ea8d3-03b4-4c54-bde3-f5989c5c2d57 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:17.383838 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8e8ea8d3-03b4-4c54-bde3-f5989c5c2d57 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:17.395031 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e8ea8d3-03b4-4c54-bde3-f5989c5c2d57 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:17.395758 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e8ea8d3-03b4-4c54-bde3-f5989c5c2d57 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:17.397057 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e8ea8d3-03b4-4c54-bde3-f5989c5c2d57 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:17.398095 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8e8ea8d3-03b4-4c54-bde3-f5989c5c2d57 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:17.543493 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8e8ea8d3-03b4-4c54-bde3-f5989c5c2d57 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:17.551830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8e8ea8d3-03b4-4c54-bde3-f5989c5c2d57 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.175498 Jun 30 13:21:17.552373 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 585/1155] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:17 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:18.573825 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c26bf641-869d-40ed-a07d-52592ca8529b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:18.574531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c26bf641-869d-40ed-a07d-52592ca8529b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:18.582677 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c26bf641-869d-40ed-a07d-52592ca8529b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:18.583197 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c26bf641-869d-40ed-a07d-52592ca8529b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:18.584080 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c26bf641-869d-40ed-a07d-52592ca8529b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:18.584581 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c26bf641-869d-40ed-a07d-52592ca8529b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:18.756028 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-c26bf641-869d-40ed-a07d-52592ca8529b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:18.764169 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c26bf641-869d-40ed-a07d-52592ca8529b tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.197110 Jun 30 13:21:18.764734 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 571/1156] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:18 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:19.784540 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-059db7d3-bb85-4610-be33-a6e8fa63575a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:19.785485 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-059db7d3-bb85-4610-be33-a6e8fa63575a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:19.795129 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-059db7d3-bb85-4610-be33-a6e8fa63575a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:19.795603 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-059db7d3-bb85-4610-be33-a6e8fa63575a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:19.796357 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-059db7d3-bb85-4610-be33-a6e8fa63575a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:19.796781 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-059db7d3-bb85-4610-be33-a6e8fa63575a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:19.943572 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-059db7d3-bb85-4610-be33-a6e8fa63575a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:19.951706 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-059db7d3-bb85-4610-be33-a6e8fa63575a tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.173727 Jun 30 13:21:19.952279 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 586/1157] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:19 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:20.969318 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f071b7f6-2b0a-4f98-a0e9-c6bb898030af tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:20.969989 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f071b7f6-2b0a-4f98-a0e9-c6bb898030af tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:20.978294 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f071b7f6-2b0a-4f98-a0e9-c6bb898030af tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:20.978294 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f071b7f6-2b0a-4f98-a0e9-c6bb898030af tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:20.978294 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f071b7f6-2b0a-4f98-a0e9-c6bb898030af tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:20.978789 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f071b7f6-2b0a-4f98-a0e9-c6bb898030af tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:21.131575 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f071b7f6-2b0a-4f98-a0e9-c6bb898030af tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:21.140282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f071b7f6-2b0a-4f98-a0e9-c6bb898030af tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.175308 Jun 30 13:21:21.140827 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 572/1158] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:20 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:22.161490 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c1d3a1f6-be7b-4c14-af22-9377e6574044 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:22.162617 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c1d3a1f6-be7b-4c14-af22-9377e6574044 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:22.174313 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1d3a1f6-be7b-4c14-af22-9377e6574044 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:22.175087 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1d3a1f6-be7b-4c14-af22-9377e6574044 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:22.176331 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1d3a1f6-be7b-4c14-af22-9377e6574044 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:22.177035 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c1d3a1f6-be7b-4c14-af22-9377e6574044 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:22.326682 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c1d3a1f6-be7b-4c14-af22-9377e6574044 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:22.335139 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c1d3a1f6-be7b-4c14-af22-9377e6574044 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.180575 Jun 30 13:21:22.335709 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 587/1159] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:22 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:23.207440 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1470858908", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2015083666", "security_groups": [{"name": "tempest-secgroup-smoke-590072109"}], "block_device_mapping_v2": [{"uuid": "26771d80-51b0-4a99-a223-cce726b0f3f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c0d94028-8912-4867-bb69-bc96650821f0"}]}} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:21:23.330213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.network.neutron [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] validate_networks() for [('c0d94028-8912-4867-bb69-bc96650821f0', None, None, None, None, None)] {{(pid=117825) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 13:21:23.353002 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-12e07c9b-6e8e-4c4b-a717-71b99430c750 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:23.353580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-12e07c9b-6e8e-4c4b-a717-71b99430c750 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:23.360645 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-12e07c9b-6e8e-4c4b-a717-71b99430c750 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:23.361077 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-12e07c9b-6e8e-4c4b-a717-71b99430c750 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:23.361835 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-12e07c9b-6e8e-4c4b-a717-71b99430c750 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:23.362255 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-12e07c9b-6e8e-4c4b-a717-71b99430c750 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:23.507772 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-12e07c9b-6e8e-4c4b-a717-71b99430c750 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:23.516165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-12e07c9b-6e8e-4c4b-a717-71b99430c750 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.167079 Jun 30 13:21:23.516744 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 588/1160] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:23 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:23.761258 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Flavor limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 13:21:23.761953 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Image limits 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 13:21:23.762810 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Flavor pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 13:21:23.763363 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Image pref 0:0:0 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 13:21:23.764029 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.virt.hardware [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117825) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 13:21:23.775211 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:23.775658 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:23.776455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:23.776881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:23.798762 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Getting quotas for project 80ff68a0b07e43d4bdb9c32f7166c9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 13:21:23.804177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.quota [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Getting quotas for user 1c4aa9e4d27c4c2ea4b49ab188f841da and project 80ff68a0b07e43d4bdb9c32f7166c9a1. Resources: {'ram', 'instances', 'cores'} {{(pid=117825) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 13:21:23.871735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Going to run 1 instances... {{(pid=117825) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 13:21:23.874164 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26771d80-51b0-4a99-a223-cce726b0f3f0',volume_size=None,volume_type=None)] {{(pid=117825) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 13:21:24.015699 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fd7caadb-d032-47f4-b9d1-93467bdd347f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.812107 Jun 30 13:21:24.016438 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 573/1161] 10.222.0.49 () {60 vars in 1146 bytes} [Thu Jun 30 13:21:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 13:21:24.026571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-38b70514-b1c1-4bf8-90e9-ce95076c134e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:24.027269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-38b70514-b1c1-4bf8-90e9-ce95076c134e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:24.085426 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-38b70514-b1c1-4bf8-90e9-ce95076c134e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:24.092626 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-38b70514-b1c1-4bf8-90e9-ce95076c134e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1095 microversion: 2.1 time: 0.069701 Jun 30 13:21:24.093327 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 589/1162] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:24 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:24.536752 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cc651836-0235-414d-bc22-3b086ac1a161 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:24.537682 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cc651836-0235-414d-bc22-3b086ac1a161 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:24.547288 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc651836-0235-414d-bc22-3b086ac1a161 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:24.547855 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc651836-0235-414d-bc22-3b086ac1a161 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:24.548640 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc651836-0235-414d-bc22-3b086ac1a161 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:24.549072 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cc651836-0235-414d-bc22-3b086ac1a161 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:24.699191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cc651836-0235-414d-bc22-3b086ac1a161 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:24.709857 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cc651836-0235-414d-bc22-3b086ac1a161 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.179485 Jun 30 13:21:24.710691 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 574/1163] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:24 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:25.111972 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-8020b011-1b4f-46b7-8567-07a11a04f1ad tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:25.112839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-8020b011-1b4f-46b7-8567-07a11a04f1ad tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:25.119580 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8020b011-1b4f-46b7-8567-07a11a04f1ad tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:25.120023 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8020b011-1b4f-46b7-8567-07a11a04f1ad tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:25.120805 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8020b011-1b4f-46b7-8567-07a11a04f1ad tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:25.121229 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-8020b011-1b4f-46b7-8567-07a11a04f1ad tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:25.187248 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-8020b011-1b4f-46b7-8567-07a11a04f1ad tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:25.194971 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-8020b011-1b4f-46b7-8567-07a11a04f1ad tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1211 microversion: 2.1 time: 0.087550 Jun 30 13:21:25.195626 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 590/1164] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:25 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:25.727665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b08469e2-2ea1-4506-99fc-852d24be5c01 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:25.728972 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b08469e2-2ea1-4506-99fc-852d24be5c01 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:25.744170 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b08469e2-2ea1-4506-99fc-852d24be5c01 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:25.744504 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b08469e2-2ea1-4506-99fc-852d24be5c01 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:25.745281 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b08469e2-2ea1-4506-99fc-852d24be5c01 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:25.745900 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b08469e2-2ea1-4506-99fc-852d24be5c01 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:25.986057 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b08469e2-2ea1-4506-99fc-852d24be5c01 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:25.994362 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b08469e2-2ea1-4506-99fc-852d24be5c01 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.270737 Jun 30 13:21:25.995023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 575/1165] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:25 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:26.212704 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-6fe04618-cc81-4b26-8c01-c16029d6bcdc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:26.213296 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-6fe04618-cc81-4b26-8c01-c16029d6bcdc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:26.220588 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6fe04618-cc81-4b26-8c01-c16029d6bcdc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:26.221035 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6fe04618-cc81-4b26-8c01-c16029d6bcdc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:26.221834 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6fe04618-cc81-4b26-8c01-c16029d6bcdc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:26.222254 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-6fe04618-cc81-4b26-8c01-c16029d6bcdc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:26.369289 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-6fe04618-cc81-4b26-8c01-c16029d6bcdc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:26.377686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-6fe04618-cc81-4b26-8c01-c16029d6bcdc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.168940 Jun 30 13:21:26.387463 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 591/1166] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:26 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:26.547545 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-cb3c3865-0d1f-4340-9bc3-8beac5d368f5 req-97f572e0-98fe-4465-8413-3989c96d8862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0300809-f3dc-4cf3-ab8e-1b31e3a0d236", "tag": "345241c5-1bc1-4246-830e-ef5cdb7b133b"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:21:26.556795 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-cb3c3865-0d1f-4340-9bc3-8beac5d368f5 req-97f572e0-98fe-4465-8413-3989c96d8862 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:26.557659 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-cb3c3865-0d1f-4340-9bc3-8beac5d368f5 req-97f572e0-98fe-4465-8413-3989c96d8862 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:26.570495 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-cb3c3865-0d1f-4340-9bc3-8beac5d368f5 req-97f572e0-98fe-4465-8413-3989c96d8862 service nova] Creating event network-changed:345241c5-1bc1-4246-830e-ef5cdb7b133b for instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 on hv-cinder-81268 Jun 30 13:21:26.575282 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-cb3c3865-0d1f-4340-9bc3-8beac5d368f5 req-97f572e0-98fe-4465-8413-3989c96d8862 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031872 Jun 30 13:21:26.575881 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 576/1167] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 13:21:27.011881 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-77136b50-0929-438c-b908-6447a167ccf4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:27.012387 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-77136b50-0929-438c-b908-6447a167ccf4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:27.018774 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-77136b50-0929-438c-b908-6447a167ccf4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:27.019232 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-77136b50-0929-438c-b908-6447a167ccf4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:27.019973 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-77136b50-0929-438c-b908-6447a167ccf4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:27.020393 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-77136b50-0929-438c-b908-6447a167ccf4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:27.191188 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-77136b50-0929-438c-b908-6447a167ccf4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:27.203562 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-77136b50-0929-438c-b908-6447a167ccf4 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1757 microversion: 2.1 time: 0.195653 Jun 30 13:21:27.204487 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 592/1168] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:27 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:27.395467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f3a0388d-5716-4788-a918-c502eaf2644e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:27.396800 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f3a0388d-5716-4788-a918-c502eaf2644e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:27.403644 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a0388d-5716-4788-a918-c502eaf2644e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:27.404163 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a0388d-5716-4788-a918-c502eaf2644e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:27.405517 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a0388d-5716-4788-a918-c502eaf2644e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:27.405675 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f3a0388d-5716-4788-a918-c502eaf2644e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:27.662799 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f3a0388d-5716-4788-a918-c502eaf2644e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:27.671795 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f3a0388d-5716-4788-a918-c502eaf2644e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.281048 Jun 30 13:21:27.672588 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 577/1169] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:27 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:28.230379 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e4fb6b4d-8fb4-45ad-8107-e074a0363697 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:28.231377 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e4fb6b4d-8fb4-45ad-8107-e074a0363697 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:28.242388 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e4fb6b4d-8fb4-45ad-8107-e074a0363697 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:28.243139 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e4fb6b4d-8fb4-45ad-8107-e074a0363697 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:28.244368 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e4fb6b4d-8fb4-45ad-8107-e074a0363697 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:28.245062 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e4fb6b4d-8fb4-45ad-8107-e074a0363697 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:28.396498 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e4fb6b4d-8fb4-45ad-8107-e074a0363697 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:28.404903 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e4fb6b4d-8fb4-45ad-8107-e074a0363697 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1760 microversion: 2.1 time: 0.181070 Jun 30 13:21:28.405500 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 593/1170] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:28 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:28.690463 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-6c11bfd2-fefd-45a4-8b0f-b98f59cb6a7e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:28.691103 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-6c11bfd2-fefd-45a4-8b0f-b98f59cb6a7e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:28.698045 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c11bfd2-fefd-45a4-8b0f-b98f59cb6a7e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:28.698529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c11bfd2-fefd-45a4-8b0f-b98f59cb6a7e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:28.699281 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c11bfd2-fefd-45a4-8b0f-b98f59cb6a7e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:28.699703 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-6c11bfd2-fefd-45a4-8b0f-b98f59cb6a7e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:28.920538 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-6c11bfd2-fefd-45a4-8b0f-b98f59cb6a7e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:28.930229 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-6c11bfd2-fefd-45a4-8b0f-b98f59cb6a7e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.244162 Jun 30 13:21:28.930839 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 578/1171] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:28 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:29.951751 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-b89263c9-9d3d-4a89-b3b2-374948b7a3e4 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:29.952704 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-b89263c9-9d3d-4a89-b3b2-374948b7a3e4 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:29.960445 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b89263c9-9d3d-4a89-b3b2-374948b7a3e4 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:29.960961 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b89263c9-9d3d-4a89-b3b2-374948b7a3e4 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:29.961840 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b89263c9-9d3d-4a89-b3b2-374948b7a3e4 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:29.962359 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-b89263c9-9d3d-4a89-b3b2-374948b7a3e4 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:30.107093 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-b89263c9-9d3d-4a89-b3b2-374948b7a3e4 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:30.115586 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-b89263c9-9d3d-4a89-b3b2-374948b7a3e4 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.170465 Jun 30 13:21:30.116168 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 594/1172] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:29 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:31.137306 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b7081ffd-e2eb-424c-b4bd-c6a33bda03e3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:31.138312 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b7081ffd-e2eb-424c-b4bd-c6a33bda03e3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:31.149695 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7081ffd-e2eb-424c-b4bd-c6a33bda03e3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:31.150573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7081ffd-e2eb-424c-b4bd-c6a33bda03e3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:31.151826 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7081ffd-e2eb-424c-b4bd-c6a33bda03e3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:31.152510 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b7081ffd-e2eb-424c-b4bd-c6a33bda03e3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:31.290152 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b7081ffd-e2eb-424c-b4bd-c6a33bda03e3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:31.298294 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b7081ffd-e2eb-424c-b4bd-c6a33bda03e3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.167599 Jun 30 13:21:31.298890 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 579/1173] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:31 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:32.324041 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c7c3c993-b890-412e-be83-c3247e71eebf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:32.324615 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-c7c3c993-b890-412e-be83-c3247e71eebf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:32.332269 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c3c993-b890-412e-be83-c3247e71eebf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:32.332718 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c3c993-b890-412e-be83-c3247e71eebf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:32.333467 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c3c993-b890-412e-be83-c3247e71eebf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:32.333895 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-c7c3c993-b890-412e-be83-c3247e71eebf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:32.477346 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-c7c3c993-b890-412e-be83-c3247e71eebf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:32.485619 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c7c3c993-b890-412e-be83-c3247e71eebf tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.167976 Jun 30 13:21:32.486191 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 595/1174] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:32 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:33.506671 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-cde9ac3d-f2af-409b-b68e-3b6279f8aeee tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:33.507571 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-cde9ac3d-f2af-409b-b68e-3b6279f8aeee tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:33.517474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cde9ac3d-f2af-409b-b68e-3b6279f8aeee tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:33.517914 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cde9ac3d-f2af-409b-b68e-3b6279f8aeee tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:33.518688 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cde9ac3d-f2af-409b-b68e-3b6279f8aeee tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:33.519117 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-cde9ac3d-f2af-409b-b68e-3b6279f8aeee tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:33.660707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-cde9ac3d-f2af-409b-b68e-3b6279f8aeee tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:33.668780 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-cde9ac3d-f2af-409b-b68e-3b6279f8aeee tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.168789 Jun 30 13:21:33.669347 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 580/1175] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:33 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:34.689940 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-39d3e50d-5b05-4b5d-89f0-d43250037513 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:34.690657 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-39d3e50d-5b05-4b5d-89f0-d43250037513 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:34.693398 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell0:SELECT=2 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:34.700089 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-39d3e50d-5b05-4b5d-89f0-d43250037513 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:34.700606 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-39d3e50d-5b05-4b5d-89f0-d43250037513 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:34.701492 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-39d3e50d-5b05-4b5d-89f0-d43250037513 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:34.701993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-39d3e50d-5b05-4b5d-89f0-d43250037513 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:34.847853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-39d3e50d-5b05-4b5d-89f0-d43250037513 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:34.859918 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-39d3e50d-5b05-4b5d-89f0-d43250037513 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.175665 Jun 30 13:21:34.860599 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 596/1176] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:34 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:35.882054 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-03b270bf-1788-4656-90e7-d04d1dc94a6e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:35.882717 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-03b270bf-1788-4656-90e7-d04d1dc94a6e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:35.884792 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=2 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:35.885529 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell0:SELECT=6 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:35.892831 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03b270bf-1788-4656-90e7-d04d1dc94a6e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:35.893273 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03b270bf-1788-4656-90e7-d04d1dc94a6e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:35.894027 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03b270bf-1788-4656-90e7-d04d1dc94a6e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:35.894482 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-03b270bf-1788-4656-90e7-d04d1dc94a6e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:36.033681 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-03b270bf-1788-4656-90e7-d04d1dc94a6e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:36.041325 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-03b270bf-1788-4656-90e7-d04d1dc94a6e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.163388 Jun 30 13:21:36.041860 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 581/1177] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:35 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:37.058993 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-57151982-4b62-4f14-9882-86cf0aa1521e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:37.059559 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-57151982-4b62-4f14-9882-86cf0aa1521e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:37.066970 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-57151982-4b62-4f14-9882-86cf0aa1521e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:37.067412 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-57151982-4b62-4f14-9882-86cf0aa1521e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:37.068174 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-57151982-4b62-4f14-9882-86cf0aa1521e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:37.068601 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-57151982-4b62-4f14-9882-86cf0aa1521e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:37.206976 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-57151982-4b62-4f14-9882-86cf0aa1521e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:37.219272 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-57151982-4b62-4f14-9882-86cf0aa1521e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.164037 Jun 30 13:21:37.219884 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 597/1178] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:37 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:38.241974 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-f0cbccc1-65e6-436f-a083-47ffcea68b4f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:38.242679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-f0cbccc1-65e6-436f-a083-47ffcea68b4f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:38.249281 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0cbccc1-65e6-436f-a083-47ffcea68b4f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:38.249748 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0cbccc1-65e6-436f-a083-47ffcea68b4f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:38.250504 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0cbccc1-65e6-436f-a083-47ffcea68b4f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:38.250950 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-f0cbccc1-65e6-436f-a083-47ffcea68b4f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:38.353673 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-54b09c89-349e-4a4c-8fe6-bb8960a189a0 req-3f372229-5913-40e2-84c3-75726ce0a004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0300809-f3dc-4cf3-ab8e-1b31e3a0d236", "name": "network-vif-plugged", "status": "completed", "tag": "345241c5-1bc1-4246-830e-ef5cdb7b133b"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:21:38.363737 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-54b09c89-349e-4a4c-8fe6-bb8960a189a0 req-3f372229-5913-40e2-84c3-75726ce0a004 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:38.364249 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-54b09c89-349e-4a4c-8fe6-bb8960a189a0 req-3f372229-5913-40e2-84c3-75726ce0a004 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:38.378952 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-54b09c89-349e-4a4c-8fe6-bb8960a189a0 req-3f372229-5913-40e2-84c3-75726ce0a004 service nova] Creating event network-vif-plugged:345241c5-1bc1-4246-830e-ef5cdb7b133b for instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 on hv-cinder-81268 Jun 30 13:21:38.384959 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-54b09c89-349e-4a4c-8fe6-bb8960a189a0 req-3f372229-5913-40e2-84c3-75726ce0a004 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035032 Jun 30 13:21:38.385942 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 598/1179] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:21:38.392908 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-f0cbccc1-65e6-436f-a083-47ffcea68b4f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:38.400345 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-f0cbccc1-65e6-436f-a083-47ffcea68b4f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.162606 Jun 30 13:21:38.400910 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 582/1180] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:38 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:39.419618 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-db5dcb20-f6f7-4a3d-b9b5-7b18fe7cc141 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:39.421068 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-db5dcb20-f6f7-4a3d-b9b5-7b18fe7cc141 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:39.431879 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-db5dcb20-f6f7-4a3d-b9b5-7b18fe7cc141 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:39.432534 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-db5dcb20-f6f7-4a3d-b9b5-7b18fe7cc141 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:39.433717 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-db5dcb20-f6f7-4a3d-b9b5-7b18fe7cc141 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:39.434400 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-db5dcb20-f6f7-4a3d-b9b5-7b18fe7cc141 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:39.575664 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-db5dcb20-f6f7-4a3d-b9b5-7b18fe7cc141 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:39.584574 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-db5dcb20-f6f7-4a3d-b9b5-7b18fe7cc141 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1266 microversion: 2.1 time: 0.169882 Jun 30 13:21:39.585157 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 599/1181] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:39 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:40.603490 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-912e2f09-7b23-4707-9644-b3188c5bce71 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:40.604144 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-912e2f09-7b23-4707-9644-b3188c5bce71 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:40.606552 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:40.613235 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-912e2f09-7b23-4707-9644-b3188c5bce71 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:40.613756 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-912e2f09-7b23-4707-9644-b3188c5bce71 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:40.614686 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-912e2f09-7b23-4707-9644-b3188c5bce71 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:40.615192 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-912e2f09-7b23-4707-9644-b3188c5bce71 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:40.618856 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:40.753999 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-912e2f09-7b23-4707-9644-b3188c5bce71 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:40.761709 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-912e2f09-7b23-4707-9644-b3188c5bce71 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1452 microversion: 2.1 time: 0.163004 Jun 30 13:21:40.762273 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 583/1182] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:40 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:40.779174 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-e32d7cdb-30ec-479f-9a15-3bc7a3736c3d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:21:40.779864 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-e32d7cdb-30ec-479f-9a15-3bc7a3736c3d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:21:40.782447 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=39 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:40.787805 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e32d7cdb-30ec-479f-9a15-3bc7a3736c3d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:40.788236 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e32d7cdb-30ec-479f-9a15-3bc7a3736c3d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:40.788999 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e32d7cdb-30ec-479f-9a15-3bc7a3736c3d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:40.789441 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-e32d7cdb-30ec-479f-9a15-3bc7a3736c3d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:40.792229 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=99 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:40.931610 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-e32d7cdb-30ec-479f-9a15-3bc7a3736c3d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:21:40.939811 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-e32d7cdb-30ec-479f-9a15-3bc7a3736c3d tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1452 microversion: 2.1 time: 0.164552 Jun 30 13:21:40.940374 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 600/1183] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:21:40 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:21:42.952353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-e9b0b808-6d5f-48c6-be1e-3600375a75f2 req-5ac18ada-32d5-4a80-ab87-5a59571bfb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0300809-f3dc-4cf3-ab8e-1b31e3a0d236", "tag": "345241c5-1bc1-4246-830e-ef5cdb7b133b"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:21:42.960837 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e9b0b808-6d5f-48c6-be1e-3600375a75f2 req-5ac18ada-32d5-4a80-ab87-5a59571bfb89 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:21:42.961267 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-e9b0b808-6d5f-48c6-be1e-3600375a75f2 req-5ac18ada-32d5-4a80-ab87-5a59571bfb89 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:21:42.973524 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-e9b0b808-6d5f-48c6-be1e-3600375a75f2 req-5ac18ada-32d5-4a80-ab87-5a59571bfb89 service nova] Creating event network-changed:345241c5-1bc1-4246-830e-ef5cdb7b133b for instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 on hv-cinder-81268 Jun 30 13:21:42.978826 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-e9b0b808-6d5f-48c6-be1e-3600375a75f2 req-5ac18ada-32d5-4a80-ab87-5a59571bfb89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030092 Jun 30 13:21:42.979421 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 584/1184] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:22:31.973061 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-79d577a6-a294-4807-931c-0d2bebf14b47 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1393334742"}} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:22:31.973826 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-79d577a6-a294-4807-931c-0d2bebf14b47 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:31.976110 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:31.976833 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=5 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:31.984165 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79d577a6-a294-4807-931c-0d2bebf14b47 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:31.984605 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79d577a6-a294-4807-931c-0d2bebf14b47 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:31.985387 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79d577a6-a294-4807-931c-0d2bebf14b47 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:31.985807 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-79d577a6-a294-4807-931c-0d2bebf14b47 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:32.123867 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.network.security_group_api [None req-79d577a6-a294-4807-931c-0d2bebf14b47 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Removing security group be784a43-cbb6-4f42-ae87-b9dcc0e52e56 from port 3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 Jun 30 13:22:32.484941 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-79d577a6-a294-4807-931c-0d2bebf14b47 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "POST /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/action" status: 202 len: 0 microversion: 2.1 time: 0.516296 Jun 30 13:22:32.486939 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 601/1185] 10.222.0.49 () {60 vars in 1277 bytes} [Thu Jun 30 13:22:31 2022] POST /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:22:32.490957 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71b8c7e2-df84-4c6d-9769-3c8d2d3ecd2e] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 30 13:22:32.492269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=3 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:32.493313 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=7 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:22:32.498766 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-a2caa2d2-eda4-4c4d-bd1e-b5a3ede24057 req-7c0c6bd2-b27e-4a7a-a333-7bdffde8948b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53291237-b1e1-4f2c-a545-4520559239f3", "tag": "3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:22:32.509661 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a2caa2d2-eda4-4c4d-bd1e-b5a3ede24057 req-7c0c6bd2-b27e-4a7a-a333-7bdffde8948b service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:32.510545 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-a2caa2d2-eda4-4c4d-bd1e-b5a3ede24057 req-7c0c6bd2-b27e-4a7a-a333-7bdffde8948b service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:32.523697 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-a2caa2d2-eda4-4c4d-bd1e-b5a3ede24057 req-7c0c6bd2-b27e-4a7a-a333-7bdffde8948b service nova] Creating event network-changed:3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 for instance 53291237-b1e1-4f2c-a545-4520559239f3 on hv-cinder-81268 Jun 30 13:22:32.530574 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-a2caa2d2-eda4-4c4d-bd1e-b5a3ede24057 req-7c0c6bd2-b27e-4a7a-a333-7bdffde8948b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041033 Jun 30 13:22:32.532113 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 585/1186] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:22:33.441561 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:22:33.441823 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Thu Jun 30 13:22:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:22:33.605722 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-793d9e51-effa-4b97-9c23-5ff76beaf456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:33.606444 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-793d9e51-effa-4b97-9c23-5ff76beaf456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:33.613061 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-793d9e51-effa-4b97-9c23-5ff76beaf456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:33.613499 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-793d9e51-effa-4b97-9c23-5ff76beaf456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:33.614264 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-793d9e51-effa-4b97-9c23-5ff76beaf456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:33.614933 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-793d9e51-effa-4b97-9c23-5ff76beaf456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:33.696981 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.objects.instance [None req-793d9e51-effa-4b97-9c23-5ff76beaf456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lazy-loading 'services' on Instance uuid 53291237-b1e1-4f2c-a545-4520559239f3 {{(pid=117826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 13:22:33.773386 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-793d9e51-effa-4b97-9c23-5ff76beaf456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "DELETE /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments/07726e32-1893-4c06-9c00-59a92c5c96da" status: 202 len: 0 microversion: 2.1 time: 0.172247 Jun 30 13:22:33.774138 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 602/1187] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:22:33 2022] DELETE /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments/07726e32-1893-4c06-9c00-59a92c5c96da => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:22:33.784448 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-bf4b57d7-914b-4636-8203-9f6e82eb2eed tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:33.786051 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-bf4b57d7-914b-4636-8203-9f6e82eb2eed tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:33.793450 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf4b57d7-914b-4636-8203-9f6e82eb2eed tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:33.793682 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf4b57d7-914b-4636-8203-9f6e82eb2eed tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:33.794707 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf4b57d7-914b-4636-8203-9f6e82eb2eed tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:33.795162 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-bf4b57d7-914b-4636-8203-9f6e82eb2eed tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:33.827492 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] [71b8c7e2-df84-4c6d-9769-3c8d2d3ecd2e] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42714. Jun 30 13:22:33.830092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-bf4b57d7-914b-4636-8203-9f6e82eb2eed tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051421 Jun 30 13:22:33.831244 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 586/1188] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:22:33 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:22:34.547686 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-0a13f1e1-aed1-4982-96b9-27d1f4869a1b req-6edbe5c1-93a7-41f0-b0eb-e981d3cc6767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53291237-b1e1-4f2c-a545-4520559239f3", "tag": "3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:22:34.556892 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-0a13f1e1-aed1-4982-96b9-27d1f4869a1b req-6edbe5c1-93a7-41f0-b0eb-e981d3cc6767 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:34.557337 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-0a13f1e1-aed1-4982-96b9-27d1f4869a1b req-6edbe5c1-93a7-41f0-b0eb-e981d3cc6767 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:34.570571 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-0a13f1e1-aed1-4982-96b9-27d1f4869a1b req-6edbe5c1-93a7-41f0-b0eb-e981d3cc6767 service nova] Creating event network-changed:3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 for instance 53291237-b1e1-4f2c-a545-4520559239f3 on hv-cinder-81268 Jun 30 13:22:34.575830 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-0a13f1e1-aed1-4982-96b9-27d1f4869a1b req-6edbe5c1-93a7-41f0-b0eb-e981d3cc6767 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032290 Jun 30 13:22:34.576485 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 603/1189] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:22:34.843808 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fea325b7-cd7d-4094-8044-67ccdbff9101 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:34.844750 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fea325b7-cd7d-4094-8044-67ccdbff9101 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:34.852653 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fea325b7-cd7d-4094-8044-67ccdbff9101 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:34.853010 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fea325b7-cd7d-4094-8044-67ccdbff9101 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:34.853842 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fea325b7-cd7d-4094-8044-67ccdbff9101 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:34.854263 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fea325b7-cd7d-4094-8044-67ccdbff9101 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:34.886210 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fea325b7-cd7d-4094-8044-67ccdbff9101 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Jun 30 13:22:34.889215 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 587/1190] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:22:34 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:22:35.175343 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:22:35.175885 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Thu Jun 30 13:22:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:22:35.904211 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-61571d70-fa54-4610-8f64-be727df46d8c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:35.905803 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-61571d70-fa54-4610-8f64-be727df46d8c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:35.916800 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-61571d70-fa54-4610-8f64-be727df46d8c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:35.917524 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-61571d70-fa54-4610-8f64-be727df46d8c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:35.918986 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-61571d70-fa54-4610-8f64-be727df46d8c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:35.919679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-61571d70-fa54-4610-8f64-be727df46d8c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:35.950916 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-61571d70-fa54-4610-8f64-be727df46d8c tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054607 Jun 30 13:22:35.951456 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 604/1191] 10.222.0.49 () {58 vars in 1301 bytes} [Thu Jun 30 13:22:35 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 13:22:35.961716 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:35.962280 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:35.970025 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:35.970496 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:35.971254 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:35.971679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:36.048594 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] HTTP exception thrown: Instance 53291237-b1e1-4f2c-a545-4520559239f3 is not attached to volume 07726e32-1893-4c06-9c00-59a92c5c96da Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Request method failure captured: Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: DELETE /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments/07726e32-1893-4c06-9c00-59a92c5c96da HTTP/1.1 Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaLQvFNDm-_jjOJYrgaQMRq2o-MvM25Lbd2wJf8hKDMUYYy3xPKO06DTaQEXK1XtNqO5tcGlfPJZVNSuaHSZTCmLhH_6k2G02qdgnoCB6M-3zZiIRsmpJqUDh7QJU1N8x8DtKHqZ_2BqEFT4oWryGugvDLM2O5FqSgECTNZDnqmepog Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 810dd4c41fca4b11938e32d08221c9b8 Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestMinimumBasicScenario-1536345890 Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:22:36.051023 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/810dd4c41fca4b11938e32d08221c9b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/810dd4c41fca4b11938e32d08221c9b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_810dd4c41fca4b11938e32d08221c9b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/810dd4c41fca4b11938e32d08221c9b8"}]}] Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestMinimumBasicScenario-1536345890 Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 810dd4c41fca4b11938e32d08221c9b8 Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1536345890 Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-TestMinimumBasicScenario-1536345890-project Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: d23750f160a445c083ad823e9b2f2d7b Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestMinimumBasicScenario-1536345890-project Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:22:36.052920 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 53291237-b1e1-4f2c-a545-4520559239f3 is not attached to volume 07726e32-1893-4c06-9c00-59a92c5c96da Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'server_id': '53291237-b1e1-4f2c-a545-4520559239f3', 'id': '07726e32-1893-4c06-9c00-59a92c5c96da'} Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 07726e32-1893-4c06-9c00-59a92c5c96da. Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:22:36.053939 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53291237-b1e1-4f2c-a545-4520559239f3 is not attached to volume 07726e32-1893-4c06-9c00-59a92c5c96da Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53291237-b1e1-4f2c-a545-4520559239f3 is not attached to volume 07726e32-1893-4c06-9c00-59a92c5c96da Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:36.055576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Returning 404 to user: Instance 53291237-b1e1-4f2c-a545-4520559239f3 is not attached to volume 07726e32-1893-4c06-9c00-59a92c5c96da {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:22:36.056907 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-8424fdbc-ee60-4bc9-96f1-0215c9b21d88 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "DELETE /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments/07726e32-1893-4c06-9c00-59a92c5c96da" status: 404 len: 154 microversion: 2.1 time: 0.094783 Jun 30 13:22:36.056907 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 588/1192] 10.222.0.49 () {58 vars in 1415 bytes} [Thu Jun 30 13:22:35 2022] DELETE /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3/os-volume_attachments/07726e32-1893-4c06-9c00-59a92c5c96da => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:22:37.205242 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-fe9523ae-5acc-4cd1-a6d5-a075a3aa2456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:37.205812 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fe9523ae-5acc-4cd1-a6d5-a075a3aa2456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:37.212630 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe9523ae-5acc-4cd1-a6d5-a075a3aa2456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:37.213067 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe9523ae-5acc-4cd1-a6d5-a075a3aa2456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:37.213813 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe9523ae-5acc-4cd1-a6d5-a075a3aa2456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:37.214230 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-fe9523ae-5acc-4cd1-a6d5-a075a3aa2456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:37.239536 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-fe9523ae-5acc-4cd1-a6d5-a075a3aa2456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:22:37.316433 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-fe9523ae-5acc-4cd1-a6d5-a075a3aa2456 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "DELETE /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 204 len: 0 microversion: 2.1 time: 0.114836 Jun 30 13:22:37.317094 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 605/1193] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:22:37 2022] DELETE /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:22:37.325848 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-fff8f0d8-6313-4996-a97c-24848587f9f9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:37.326567 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-fff8f0d8-6313-4996-a97c-24848587f9f9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:37.333684 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fff8f0d8-6313-4996-a97c-24848587f9f9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:37.334121 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fff8f0d8-6313-4996-a97c-24848587f9f9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:37.334901 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fff8f0d8-6313-4996-a97c-24848587f9f9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:37.335329 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-fff8f0d8-6313-4996-a97c-24848587f9f9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:37.483261 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-fff8f0d8-6313-4996-a97c-24848587f9f9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:22:37.492206 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-fff8f0d8-6313-4996-a97c-24848587f9f9 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1554 microversion: 2.1 time: 0.170247 Jun 30 13:22:37.492770 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 589/1194] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:22:37 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:22:38.521304 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-1602eafa-e348-4aaf-87d9-89b1235ae9ce tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:38.522263 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-1602eafa-e348-4aaf-87d9-89b1235ae9ce tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:38.533290 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1602eafa-e348-4aaf-87d9-89b1235ae9ce tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:38.533821 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1602eafa-e348-4aaf-87d9-89b1235ae9ce tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:38.534707 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1602eafa-e348-4aaf-87d9-89b1235ae9ce tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:38.535129 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-1602eafa-e348-4aaf-87d9-89b1235ae9ce tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:38.671177 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-1602eafa-e348-4aaf-87d9-89b1235ae9ce tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:22:38.678944 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-1602eafa-e348-4aaf-87d9-89b1235ae9ce tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1554 microversion: 2.1 time: 0.165067 Jun 30 13:22:38.679507 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 606/1195] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:22:38 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:22:39.702566 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-27b8de19-a15b-4221-98d1-3705b7d6f18e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:39.703167 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-27b8de19-a15b-4221-98d1-3705b7d6f18e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:39.710092 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b8de19-a15b-4221-98d1-3705b7d6f18e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:39.710573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b8de19-a15b-4221-98d1-3705b7d6f18e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:39.711354 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b8de19-a15b-4221-98d1-3705b7d6f18e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:39.711763 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-27b8de19-a15b-4221-98d1-3705b7d6f18e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:39.932943 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-27b8de19-a15b-4221-98d1-3705b7d6f18e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23750f160a445c083ad823e9b2f2d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dd4c41fca4b11938e32d08221c9b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:22:39.941281 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-27b8de19-a15b-4221-98d1-3705b7d6f18e tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 200 len: 1554 microversion: 2.1 time: 0.243683 Jun 30 13:22:39.941919 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 590/1196] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:22:39 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:22:40.202104 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-81c112ab-a8f0-4276-a7c9-22449fa715fc req-0c703510-46b1-41bf-aef5-3ea486f4d742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53291237-b1e1-4f2c-a545-4520559239f3", "name": "network-vif-deleted", "tag": "3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:22:40.212029 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-81c112ab-a8f0-4276-a7c9-22449fa715fc req-0c703510-46b1-41bf-aef5-3ea486f4d742 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:40.212463 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-81c112ab-a8f0-4276-a7c9-22449fa715fc req-0c703510-46b1-41bf-aef5-3ea486f4d742 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:40.224779 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-81c112ab-a8f0-4276-a7c9-22449fa715fc req-0c703510-46b1-41bf-aef5-3ea486f4d742 service nova] Creating event network-vif-deleted:3db83d3c-25f9-4f4b-9efc-e0ef6a72c6c6 for instance 53291237-b1e1-4f2c-a545-4520559239f3 on hv-cinder-81268 Jun 30 13:22:40.229793 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-81c112ab-a8f0-4276-a7c9-22449fa715fc req-0c703510-46b1-41bf-aef5-3ea486f4d742 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 Jun 30 13:22:40.230423 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 607/1197] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:22:40.959474 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:40.960194 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] [instance: 53291237-b1e1-4f2c-a545-4520559239f3] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:22:40.968130 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:40.968616 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:40.969455 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:22:40.969927 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:22:40.985854 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] HTTP exception thrown: Instance 53291237-b1e1-4f2c-a545-4520559239f3 could not be found. Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Request method failure captured: Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 HTTP/1.1 Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaLQvFNDm-_jjOJYrgaQMRq2o-MvM25Lbd2wJf8hKDMUYYy3xPKO06DTaQEXK1XtNqO5tcGlfPJZVNSuaHSZTCmLhH_6k2G02qdgnoCB6M-3zZiIRsmpJqUDh7QJU1N8x8DtKHqZ_2BqEFT4oWryGugvDLM2O5FqSgECTNZDnqmepog Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 810dd4c41fca4b11938e32d08221c9b8 Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestMinimumBasicScenario-1536345890 Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:22:40.987665 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/810dd4c41fca4b11938e32d08221c9b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/810dd4c41fca4b11938e32d08221c9b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_810dd4c41fca4b11938e32d08221c9b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/810dd4c41fca4b11938e32d08221c9b8"}]}] Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestMinimumBasicScenario-1536345890 Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 810dd4c41fca4b11938e32d08221c9b8 Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1536345890 Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-TestMinimumBasicScenario-1536345890-project Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: d23750f160a445c083ad823e9b2f2d7b Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestMinimumBasicScenario-1536345890-project Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 53291237-b1e1-4f2c-a545-4520559239f3 could not be found. Jun 30 13:22:40.989364 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '53291237-b1e1-4f2c-a545-4520559239f3'} Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53291237-b1e1-4f2c-a545-4520559239f3 could not be found. Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:22:40.990232 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53291237-b1e1-4f2c-a545-4520559239f3 could not be found. Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53291237-b1e1-4f2c-a545-4520559239f3 could not be found. Jun 30 13:22:40.991604 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:22:40.992840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Returning 404 to user: Instance 53291237-b1e1-4f2c-a545-4520559239f3 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:22:40.992840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-c6069881-085c-43fc-b8b8-b4466ba29c46 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3" status: 404 len: 111 microversion: 2.1 time: 0.034216 Jun 30 13:22:40.992840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 591/1198] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:22:40 2022] GET /compute/v2.1/servers/53291237-b1e1-4f2c-a545-4520559239f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:22:41.000999 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-c9d15339-1b21-46e9-94e9-c4cc7aa48186 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] Calling method '.version_select at 0x7f4ba427ea60>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:22:41.027948 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-c9d15339-1b21-46e9-94e9-c4cc7aa48186 tempest-TestMinimumBasicScenario-1536345890 tempest-TestMinimumBasicScenario-1536345890-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1608258662" status: 202 len: 0 microversion: 2.1 time: 0.033681 Jun 30 13:22:41.028432 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 608/1199] 10.222.0.49 () {58 vars in 1271 bytes} [Thu Jun 30 13:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1608258662 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:23:32.729937 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b760c76b-91d5-4843-933e-423960e8ed61 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:32.730746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:23:32.731177 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b760c76b-91d5-4843-933e-423960e8ed61 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:32.731888 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG dbcounter [-] [117826] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:23:32.733614 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_api:SELECT=14 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:23:32.734236 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG dbcounter [-] [117825] Writing DB stats nova_cell1:SELECT=34 {{(pid=117825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:23:32.739999 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b760c76b-91d5-4843-933e-423960e8ed61 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:32.740559 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b760c76b-91d5-4843-933e-423960e8ed61 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:32.741575 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b760c76b-91d5-4843-933e-423960e8ed61 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:32.741896 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b760c76b-91d5-4843-933e-423960e8ed61 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:32.771492 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b760c76b-91d5-4843-933e-423960e8ed61 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Going to try to terminate instance {{(pid=117825) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:23:32.862579 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b760c76b-91d5-4843-933e-423960e8ed61 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 204 len: 0 microversion: 2.1 time: 0.134905 Jun 30 13:23:32.863747 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 592/1200] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:23:32 2022] DELETE /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:23:32.874238 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-df873aca-d0f0-4faf-bdad-17ff6be0129a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:32.875191 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-df873aca-d0f0-4faf-bdad-17ff6be0129a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:32.885193 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [req-1ab3dd0b-6d9b-4706-83ff-e0bed3153a3e req-c09f66fb-d836-41a4-b1f9-e199e948957c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0300809-f3dc-4cf3-ab8e-1b31e3a0d236", "tag": "345241c5-1bc1-4246-830e-ef5cdb7b133b"}]} {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:23:32.890238 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df873aca-d0f0-4faf-bdad-17ff6be0129a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:32.890783 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df873aca-d0f0-4faf-bdad-17ff6be0129a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:32.891947 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df873aca-d0f0-4faf-bdad-17ff6be0129a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:32.892796 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-df873aca-d0f0-4faf-bdad-17ff6be0129a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:32.894678 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-1ab3dd0b-6d9b-4706-83ff-e0bed3153a3e req-c09f66fb-d836-41a4-b1f9-e199e948957c service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:32.895108 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [req-1ab3dd0b-6d9b-4706-83ff-e0bed3153a3e req-c09f66fb-d836-41a4-b1f9-e199e948957c service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:32.905499 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.compute.server_external_events [req-1ab3dd0b-6d9b-4706-83ff-e0bed3153a3e req-c09f66fb-d836-41a4-b1f9-e199e948957c service nova] Creating event network-changed:345241c5-1bc1-4246-830e-ef5cdb7b133b for instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 on hv-cinder-81268 Jun 30 13:23:32.910832 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [req-1ab3dd0b-6d9b-4706-83ff-e0bed3153a3e req-c09f66fb-d836-41a4-b1f9-e199e948957c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181497 Jun 30 13:23:32.911749 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 609/1201] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:23:33.030275 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-df873aca-d0f0-4faf-bdad-17ff6be0129a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:23:33.038265 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-df873aca-d0f0-4faf-bdad-17ff6be0129a tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1576 microversion: 2.1 time: 0.169605 Jun 30 13:23:33.038863 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 593/1202] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:32 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:23:34.057950 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-3ec097a9-bec2-4959-bb4f-b45cc1a31594 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:34.058660 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-3ec097a9-bec2-4959-bb4f-b45cc1a31594 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:34.065369 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3ec097a9-bec2-4959-bb4f-b45cc1a31594 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:34.065806 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3ec097a9-bec2-4959-bb4f-b45cc1a31594 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:34.066601 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3ec097a9-bec2-4959-bb4f-b45cc1a31594 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:34.067028 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-3ec097a9-bec2-4959-bb4f-b45cc1a31594 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:34.207451 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-3ec097a9-bec2-4959-bb4f-b45cc1a31594 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:23:34.218406 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-3ec097a9-bec2-4959-bb4f-b45cc1a31594 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1576 microversion: 2.1 time: 0.164823 Jun 30 13:23:34.219431 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 610/1203] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:34 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:23:35.161620 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-deaf8068-4117-4409-ac72-a578024c04fa req-d6341117-b5aa-49f4-a50b-7a8630a23cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0300809-f3dc-4cf3-ab8e-1b31e3a0d236", "name": "network-vif-deleted", "tag": "345241c5-1bc1-4246-830e-ef5cdb7b133b"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:23:35.170091 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-deaf8068-4117-4409-ac72-a578024c04fa req-d6341117-b5aa-49f4-a50b-7a8630a23cd8 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:35.170576 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-deaf8068-4117-4409-ac72-a578024c04fa req-d6341117-b5aa-49f4-a50b-7a8630a23cd8 service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:35.185158 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-deaf8068-4117-4409-ac72-a578024c04fa req-d6341117-b5aa-49f4-a50b-7a8630a23cd8 service nova] Creating event network-vif-deleted:345241c5-1bc1-4246-830e-ef5cdb7b133b for instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 on hv-cinder-81268 Jun 30 13:23:35.190814 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-deaf8068-4117-4409-ac72-a578024c04fa req-d6341117-b5aa-49f4-a50b-7a8630a23cd8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033861 Jun 30 13:23:35.191679 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 594/1204] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:23:35.237030 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-837ec1fd-ef8f-4b81-a1a5-05a25698aca2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:35.237646 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-837ec1fd-ef8f-4b81-a1a5-05a25698aca2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:35.243946 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-837ec1fd-ef8f-4b81-a1a5-05a25698aca2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:35.244390 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-837ec1fd-ef8f-4b81-a1a5-05a25698aca2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:35.245146 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-837ec1fd-ef8f-4b81-a1a5-05a25698aca2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:35.245572 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-837ec1fd-ef8f-4b81-a1a5-05a25698aca2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:35.315900 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-837ec1fd-ef8f-4b81-a1a5-05a25698aca2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:23:35.323535 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-837ec1fd-ef8f-4b81-a1a5-05a25698aca2 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 200 len: 1226 microversion: 2.1 time: 0.091099 Jun 30 13:23:35.324116 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 611/1205] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:35 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:23:36.345097 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:36.346063 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: a0300809-f3dc-4cf3-ab8e-1b31e3a0d236] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:36.353403 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:36.353840 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:36.354626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:36.355049 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:36.368818 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] HTTP exception thrown: Instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 could not be found. Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Request method failure captured: Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 HTTP/1.1 Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaHeaMLQDWDEkEcYhwlTJb0Azr_YPeT-t7IosrBU3PabAfwPpZpJaUclala3EJNxqM8rpWtoJLVp9wt8X33wXc-XX9fFXHmi33hBJxifQvUeJMGXgHb7vKyz2UDaPLROHeiRQdrpy7tkSGlv68OZKrusx-Uush6W5e5fdylXzp_ChZk Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:23:36.370464 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}] Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 1c4aa9e4d27c4c2ea4b49ab188f841da Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 could not be found. Jun 30 13:23:36.372030 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': 'a0300809-f3dc-4cf3-ab8e-1b31e3a0d236'} Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 could not be found. Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:23:36.372859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 could not be found. Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 could not be found. Jun 30 13:23:36.374531 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:36.376353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Returning 404 to user: Instance a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:23:36.376353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-34acaed8-88b3-41e5-9606-086f7342b734 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236" status: 404 len: 111 microversion: 2.1 time: 0.033962 Jun 30 13:23:36.376353 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 595/1206] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:36 2022] GET /compute/v2.1/servers/a0300809-f3dc-4cf3-ab8e-1b31e3a0d236 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:23:39.516137 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-ca3d76a5-d048-434a-878e-d094588434cc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:39.516705 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ca3d76a5-d048-434a-878e-d094588434cc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:39.518225 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-be7d3faa-a221-4300-9a0e-0094e561e254 req-20accb94-74ac-42b8-a73f-497cd8099eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85fcb5a3-550c-4487-88ea-d2b76619ef26", "tag": "4d7204da-de14-40a4-a2b5-d7cc301b8618"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:23:39.524163 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ca3d76a5-d048-434a-878e-d094588434cc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:39.524897 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ca3d76a5-d048-434a-878e-d094588434cc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:39.525730 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ca3d76a5-d048-434a-878e-d094588434cc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:39.526242 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-ca3d76a5-d048-434a-878e-d094588434cc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:39.527578 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-be7d3faa-a221-4300-9a0e-0094e561e254 req-20accb94-74ac-42b8-a73f-497cd8099eca service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:39.528007 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-be7d3faa-a221-4300-9a0e-0094e561e254 req-20accb94-74ac-42b8-a73f-497cd8099eca service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:39.540859 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-be7d3faa-a221-4300-9a0e-0094e561e254 req-20accb94-74ac-42b8-a73f-497cd8099eca service nova] Creating event network-changed:4d7204da-de14-40a4-a2b5-d7cc301b8618 for instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 on hv-cinder-81268 Jun 30 13:23:39.546284 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-be7d3faa-a221-4300-9a0e-0094e561e254 req-20accb94-74ac-42b8-a73f-497cd8099eca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031693 Jun 30 13:23:39.550310 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 596/1207] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:23:39.555746 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-ca3d76a5-d048-434a-878e-d094588434cc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Going to try to terminate instance {{(pid=117826) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 13:23:39.647838 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-ca3d76a5-d048-434a-878e-d094588434cc tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "DELETE /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 204 len: 0 microversion: 2.1 time: 0.134932 Jun 30 13:23:39.652090 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 612/1208] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:23:39 2022] DELETE /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 13:23:39.659778 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-b697e797-5551-442a-ba89-1ec01666c9c5 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:39.660470 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-b697e797-5551-442a-ba89-1ec01666c9c5 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:39.668817 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b697e797-5551-442a-ba89-1ec01666c9c5 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:39.669256 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b697e797-5551-442a-ba89-1ec01666c9c5 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:39.670020 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b697e797-5551-442a-ba89-1ec01666c9c5 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:39.670467 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-b697e797-5551-442a-ba89-1ec01666c9c5 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:39.809864 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.policy [None req-b697e797-5551-442a-ba89-1ec01666c9c5 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117825) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:23:39.819389 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-b697e797-5551-442a-ba89-1ec01666c9c5 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1577 microversion: 2.1 time: 0.164471 Jun 30 13:23:39.819978 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 597/1209] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:39 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:23:40.838053 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-d52d7809-0b56-4237-9480-b94f553ce356 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:40.838756 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-d52d7809-0b56-4237-9480-b94f553ce356 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:40.846147 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d52d7809-0b56-4237-9480-b94f553ce356 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:40.851258 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d52d7809-0b56-4237-9480-b94f553ce356 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:40.851258 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d52d7809-0b56-4237-9480-b94f553ce356 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:40.851258 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-d52d7809-0b56-4237-9480-b94f553ce356 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:41.020081 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-d52d7809-0b56-4237-9480-b94f553ce356 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:23:41.028315 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-d52d7809-0b56-4237-9480-b94f553ce356 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1577 microversion: 2.1 time: 0.194876 Jun 30 13:23:41.028889 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 613/1210] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:40 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:23:41.943617 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [req-206c6dd2-2672-4d8f-a5ca-4b054096879c req-34fc90ea-b0df-493e-9c4c-36f60ff6a62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85fcb5a3-550c-4487-88ea-d2b76619ef26", "name": "network-vif-deleted", "tag": "4d7204da-de14-40a4-a2b5-d7cc301b8618"}]} {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 13:23:41.953718 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-206c6dd2-2672-4d8f-a5ca-4b054096879c req-34fc90ea-b0df-493e-9c4c-36f60ff6a62d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:41.954052 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [req-206c6dd2-2672-4d8f-a5ca-4b054096879c req-34fc90ea-b0df-493e-9c4c-36f60ff6a62d service nova] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:41.965700 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.compute.server_external_events [req-206c6dd2-2672-4d8f-a5ca-4b054096879c req-34fc90ea-b0df-493e-9c4c-36f60ff6a62d service nova] Creating event network-vif-deleted:4d7204da-de14-40a4-a2b5-d7cc301b8618 for instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 on hv-cinder-81268 Jun 30 13:23:41.971611 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [req-206c6dd2-2672-4d8f-a5ca-4b054096879c req-34fc90ea-b0df-493e-9c4c-36f60ff6a62d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032274 Jun 30 13:23:41.972269 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 598/1211] 10.222.0.49 () {64 vars in 1317 bytes} [Thu Jun 30 13:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 13:23:42.045016 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-557a37ef-e917-4c78-a1b5-eba14c8d90c3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:42.045550 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-557a37ef-e917-4c78-a1b5-eba14c8d90c3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:42.052241 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-557a37ef-e917-4c78-a1b5-eba14c8d90c3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:42.052679 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-557a37ef-e917-4c78-a1b5-eba14c8d90c3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:42.053637 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-557a37ef-e917-4c78-a1b5-eba14c8d90c3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:42.054066 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-557a37ef-e917-4c78-a1b5-eba14c8d90c3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:42.123204 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.policy [None req-557a37ef-e917-4c78-a1b5-eba14c8d90c3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4aa9e4d27c4c2ea4b49ab188f841da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff68a0b07e43d4bdb9c32f7166c9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117826) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 13:23:42.132785 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-557a37ef-e917-4c78-a1b5-eba14c8d90c3 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 200 len: 1226 microversion: 2.1 time: 0.091577 Jun 30 13:23:42.133356 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 614/1212] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:42 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 13:23:43.153935 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:43.154819 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 85fcb5a3-550c-4487-88ea-d2b76619ef26] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:43.162949 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:43.163518 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:43.164446 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:43.164969 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:43.181237 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] HTTP exception thrown: Instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 could not be found. Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Request method failure captured: Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 HTTP/1.1 Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaHeaMLQDWDEkEcYhwlTJb0Azr_YPeT-t7IosrBU3PabAfwPpZpJaUclala3EJNxqM8rpWtoJLVp9wt8X33wXc-XX9fFXHmi33hBJxifQvUeJMGXgHb7vKyz2UDaPLROHeiRQdrpy7tkSGlv68OZKrusx-Uush6W5e5fdylXzp_ChZk Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:23:43.182913 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}] Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 1c4aa9e4d27c4c2ea4b49ab188f841da Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 could not be found. Jun 30 13:23:43.184652 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '85fcb5a3-550c-4487-88ea-d2b76619ef26'} Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 could not be found. Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:23:43.185601 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 could not be found. Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 could not be found. Jun 30 13:23:43.187213 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.188662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Returning 404 to user: Instance 85fcb5a3-550c-4487-88ea-d2b76619ef26 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:23:43.188662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-560c66a0-668e-4017-8e93-bc695f5a945f tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26" status: 404 len: 111 microversion: 2.1 time: 0.036840 Jun 30 13:23:43.188662 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 599/1213] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:43 2022] GET /compute/v2.1/servers/85fcb5a3-550c-4487-88ea-d2b76619ef26 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:23:43.638214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:43.638766 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.compute.api [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117826) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:43.645771 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:43.646202 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:43.646974 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:43.647565 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG oslo_concurrency.lockutils [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:43.661998 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.wsgi [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] HTTP exception thrown: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Request method failure captured: Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: request: DELETE /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 HTTP/1.1 Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept: application/json Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Accept-Encoding: identity Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Connection: close Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Length: 0 Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Content-Type: application/json Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Host: 10.222.0.49 Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Openstack-System-Scope: None Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: User-Agent: python-urllib3/1.26.9 Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Auth-Token: gAAAAABivaHeaMLQDWDEkEcYhwlTJb0Azr_YPeT-t7IosrBU3PabAfwPpZpJaUclala3EJNxqM8rpWtoJLVp9wt8X33wXc-XX9fFXHmi33hBJxifQvUeJMGXgHb7vKyz2UDaPLROHeiRQdrpy7tkSGlv68OZKrusx-Uush6W5e5fdylXzp_ChZk Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Id: None Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Domain-Name: None Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Identity-Status: Confirmed Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Is-Admin-Project: True Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Id: default Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Domain-Name: Default Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Project-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Role: member,reader Jun 30 13:23:43.663917 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Roles: member,reader Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}] Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-Tenant-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Id: default Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Domain-Name: Default Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Id: 1c4aa9e4d27c4c2ea4b49ab188f841da Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: X-User-Name: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: method: > Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: exception: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.665564 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: action_args: {'id': '5339395e-cb3b-47b8-a0c6-a695a9909c35'} Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:23:43.666501 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.667853 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.669214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Returning 404 to user: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. {{(pid=117826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:23:43.669214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-9053d315-df9e-408e-8518-bf0010c9517e tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 404 len: 111 microversion: 2.1 time: 0.031016 Jun 30 13:23:43.669214 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 615/1214] 10.222.0.49 () {58 vars in 1238 bytes} [Thu Jun 30 13:23:43 2022] DELETE /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:23:43.674656 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '>' {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:43.675261 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.compute.api [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] [instance: 5339395e-cb3b-47b8-a0c6-a695a9909c35] Fetching instance by UUID {{(pid=117825) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 13:23:43.681626 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:43.682056 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:43.682830 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 13:23:43.683252 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG oslo_concurrency.lockutils [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Lock "bc35a938-b727-4fea-a6e5-cd9d9ebc6a61" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 13:23:43.697542 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.wsgi [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] HTTP exception thrown: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Request method failure captured: Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: request: GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 HTTP/1.1 Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept: application/json Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Accept-Encoding: identity Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Connection: close Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Length: 0 Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Content-Type: application/json Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Host: 10.222.0.49 Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Openstack-System-Scope: None Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: User-Agent: python-urllib3/1.26.9 Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Auth-Token: gAAAAABivaHeaMLQDWDEkEcYhwlTJb0Azr_YPeT-t7IosrBU3PabAfwPpZpJaUclala3EJNxqM8rpWtoJLVp9wt8X33wXc-XX9fFXHmi33hBJxifQvUeJMGXgHb7vKyz2UDaPLROHeiRQdrpy7tkSGlv68OZKrusx-Uush6W5e5fdylXzp_ChZk Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Id: None Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Domain-Name: None Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Identity-Status: Confirmed Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Is-Admin-Project: True Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Id: default Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Domain-Name: Default Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Project-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Role: member,reader Jun 30 13:23:43.699073 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Roles: member,reader Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_80ff68a0b07e43d4bdb9c32f7166c9a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/80ff68a0b07e43d4bdb9c32f7166c9a1"}]}] Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Id: 80ff68a0b07e43d4bdb9c32f7166c9a1 Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-Tenant-Name: tempest-TestVolumeBootPattern-845338843 Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Id: default Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Domain-Name: Default Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Id: 1c4aa9e4d27c4c2ea4b49ab188f841da Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: X-User-Name: tempest-TestVolumeBootPattern-845338843-project Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: method: > Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: exception: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.700735 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: action_args: {'id': '5339395e-cb3b-47b8-a0c6-a695a9909c35'} Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: {{(pid=117825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 13:23:43.701630 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. Jun 30 13:23:43.703328 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: ERROR nova.api.openstack.wsgi Jun 30 13:23:43.705115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: DEBUG nova.api.openstack.wsgi [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Returning 404 to user: Instance 5339395e-cb3b-47b8-a0c6-a695a9909c35 could not be found. {{(pid=117825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 13:23:43.705115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO nova.api.openstack.requestlog [None req-1b8578d8-156f-4bfe-b91a-558db17f5a39 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35" status: 404 len: 111 microversion: 2.1 time: 0.029618 Jun 30 13:23:43.705115 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: [pid: 117825|app: 0|req: 600/1215] 10.222.0.49 () {58 vars in 1235 bytes} [Thu Jun 30 13:23:43 2022] GET /compute/v2.1/servers/5339395e-cb3b-47b8-a0c6-a695a9909c35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 13:23:45.023268 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: DEBUG nova.api.openstack.wsgi [None req-5e89a31c-a0ca-4ed2-a9fb-ef6f018bbc38 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] Calling method '.version_select at 0x7f4ba40a29d0>' {{(pid=117826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 13:23:45.042857 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO nova.api.openstack.requestlog [None req-5e89a31c-a0ca-4ed2-a9fb-ef6f018bbc38 tempest-TestVolumeBootPattern-845338843 tempest-TestVolumeBootPattern-845338843-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2015083666" status: 202 len: 0 microversion: 2.1 time: 0.023489 Jun 30 13:23:45.043494 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: [pid: 117826|app: 0|req: 616/1216] 10.222.0.49 () {58 vars in 1262 bytes} [Thu Jun 30 13:23:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2015083666 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 13:24:20.395573 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:24:20.396233 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Thu Jun 30 13:24:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:24:23.167047 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:24:23.167989 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Thu Jun 30 13:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:25:53.451540 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:25:53.452544 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Thu Jun 30 13:25:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:26:19.346760 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:26:19.347477 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Thu Jun 30 13:26:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:26:19.371813 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:26:19.372302 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Thu Jun 30 13:26:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:27:40.406405 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:27:40.407386 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Thu Jun 30 13:27:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:27:43.180839 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:27:43.181776 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Thu Jun 30 13:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:29:13.465949 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:29:13.468427 dv-cinder-812685-14-iscsi devstack@n-api.service[117825]: Thu Jun 30 13:29:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 13:29:15.189919 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 13:29:15.190931 dv-cinder-812685-14-iscsi devstack@n-api.service[117826]: Thu Jun 30 13:29:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!